Senior Data Engineer

• Join So Energy, the customer-centric, tech-led UK energy supplier, in a hybrid role at its Chiswick, London HQ. • Help the UK on its journey to a net-zero future through better data. • Develop and maintain scalable data infrastructure and pipelines on Google Cloud Platform. • Build and optimise the company’s lakehouse on GCP. • Contribute to critical projects while mentoring junior engineers. • Drive best practice and innovation within the data engineering team.

• Bring expert knowledge of GCP services, including BigQuery, Dataflow, Pub/Sub, Cloud Composer, Cloud Storage and Cloud Functions. • Write advanced SQL for complex data transformation and query optimisation. • Show proven experience building scalable data pipelines in Python. • Use Terraform to automate GCP resource management as infrastructure as code. • Understand CI/CD pipelines and automated deployment practices. • Bring experience with containerisation tools such as Docker and Kubernetes. • Build and optimise both batch and streaming data pipelines. • Understand data governance, GCP security (IAM, VPC) and compliance requirements. • Collaborate across Data Science, Engineering and Analytics teams. • Solve complex problems in a structured way while balancing short-term needs with long-term scalability. • Commute to the Chiswick office on a hybrid basis.

• Hold the GCP Professional Data Engineer certification. • Bring experience designing star schema data models for analytical workloads. • Show experience working in the energy or utilities sector. • Bring experience managing cloud costs and optimising resource usage.

• Design, develop and maintain scalable data pipelines on the GCP stack. • Build and optimise the lakehouse on Google Cloud Platform. • Implement ingestion, transformation and loading processes for databases, APIs and cloud storage. • Ensure data quality, consistency and security throughout the pipeline. • Build cloud-native solutions using Dataflow, Dataproc, BigQuery and Cloud Storage. • Automate provisioning and configuration with Terraform. • Manage cloud resources for cost-efficiency and performance. • Design star schema data models for analytical and operational workloads. • Work with data analysts on advanced analytics solutions and run data quality analysis on the Curated Layer. • Mentor junior data engineers and help set engineering best practices.

• Earn up to a 10% performance bonus and benefit from annual salary reviews. • Work in a hybrid setup based on your team’s working charter. • Get your birthday off and three paid So Giving Days for causes you care about. • Benefit from enhanced family leave. • Grow through a dedicated L&D team, a learning platform and support for certifications. • Use a 24/7 Employee Assistance Programme and Perkbox wellbeing perks and discounts. • Get free eye tests and annual flu vaccinations. • Join affinity groups, monthly social events and charity fundraising.

So Energy was founded in 2015 to show that energy suppliers could be better. It has grown to serve 300,000 customers with over 450 employees, and is working towards a net-zero future through its partnership with ESB. The company is customer-centric, tech-led and passionate about sustainability.