Senior Data Engineer

Job Description:

Deriva Energy is a leading Independent Power Producer in the US renewables market, with over 6 GW of operating or under construction wind, solar and storage projects across the country. Deriva's ultimate parent is Brookfield Renewable and is poised for dynamic growth across its wind, solar, and storage portfolios. Join a dynamic team committed to excellence and innovation who envision a future of energy independence using resilient, carbon-free generation. We offer competitive compensation, comprehensive benefits, and the opportunity to make a significant impact in the rapidly evolving renewable energy industry. Deriva empowers customers with innovative clean energy solutions that strengthen communities and serve future generations

We are seeking a highly skilled Senior Data Engineer to join our data analytics team in the renewable energy sector. You will work primarily with our data scientists on large-scale data, leveraging the latest cloud-native technologies to design, build, and optimize data pipelines and data platforms. The ideal candidate is innovative and a passionate data engineer who thrives in a fast-paced environment and wants to make a significant impact through data.

Responsibilities

• Design, build, and maintain scalable data pipelines for real-time and batch processing of renewable energy data (e.g., solar, wind, battery storage).
• Collaborate with data scientists, analysts, and software engineers to ensure high-quality data is readily available for analytics, ML models, and operational dashboards.
• Develop and manage robust ETL/ELT processes across various data sources, including IoT devices, energy monitoring platforms, and third-party APIs.
• Architect and optimize data lakes and data warehouses (e.g.,databricks,Redshift) to support business intelligence and reporting needs.
• Implement best practices for data governance, quality, and security, ensuring compliance with industry and regulatory standards.
• Research opportunities for data acquisition and new uses for existing data

Basic Qualifications

• Bachelor's degree in Computer Science, Engineering, or a related field
• Five (5) years or more of increasingly diverse or complex experience in related field in addition to degree

Desired Qualifications

• Experience with Databricks, Delta Lake, Databricks SQL & Unity Catalog, Job scheduling & workflows, Cluster configuration and tuning, Notebooks & DBFS, Integration with AWS
• Hands-on experience in Spark/PySpark handling big data within an enterprise big data platform
• Five (5) years or more of hands-on experience working with large-scale distributed data
• Strong programming skills in Python
• Experience with AWS cloud services, S3 (data lake storage), Glue (ETL & Data Catalog), Lambda (event-driven computing), Redshift (data warehouse), Athena (querying S3 data), EMR (Spark cluster), IAM (security & access control)
• Solid understanding of data modeling, relational databases (e.g., PostgreSQL, MySQL), and writing optimized SQL queries
• Experience with modern ETL/ELT tools and orchestration frameworks (e.g., AWS Step Functions, Databricks workflows)
• Experience implementing CI/CD pipelines for data workflows (e.g., using Git, GitHub Action, Docker, Terraform, etc.).
• Familiarity with Agile/Scrum practices and DevOps methodologies
• Excellent problem-solving skills and the ability to work independently as well as collaboratively in a team
• Familiar with Azure and GCP

Working Conditions

• This role is intended to be located at the Deriva Headquarters office in Charlotte, NC. This position is hybrid.

Benefits

• Health Insurance
• Dental Insurance
• Vision Insurance
• 401(k) with matching
• Employee assistance program
• Flexible spending account
• Life insurance
• Paid time off
• Parental leave
• Attractive Bonus Potential

Additional Information:

Applicants must be authorized to work for ANY employer in the U.S. We are unable to sponsor or take over sponsorship of an employment Visa at this time.

Deriva welcomes veterans of the United States Armed Forces to apply for this position. Deriva includes veterans of all branches and a diverse set of occupational specialties. We value the independent thinking, problem solving, leadership, and teamwork that our veterans have developed through their service. We welcome applications from any service and any military occupational specialty.

Deriva Energy is an Equal Opportunity and Affirmative Action Employer encouraging diversity in the workplace. All qualified applicants will receive consideration for employment without regard to their race, color, creed, religion, national origin, citizenship status, ancestry, sex, age, physical or mental disability, marital status, family responsibilities, pregnancy, genetic information, sexual orientation, gender expression, gender identity, transgender, sex stereotyping, protected veteran or military status, and other categories protected by federal, state or local law.