Vacancy title:
Senior Data Engineer
Jobs at:
UpEnergyDeadline of this Job:
Sunday, February 02 2025
Summary
Date Posted: Monday, January 27 2025, Base Salary: Not Disclosed
JOB DETAILS:
UpEnergy delivers high-impact, emission-reducing projects that accelerate decarbonization and create long-term benefits for local communities. We focus on making life-improving clean technologies available across Africa, impacting millions of lives and significantly reducing CO2 emissions. With a growing team spread across multiple countries, we seek motivated and entrepreneurial talent eager to help us deliver even more impact.
About the role:
UpEnergy is seeking an experienced Data Engineer to lead the design, implementation, and optimization of our backend and reporting databases, including integration with AWS. This role is critical in supporting our migration from Salesforce and establishing a scalable, cloud-based data infrastructure. The ideal candidate will have expertise in database architecture, ETL development, and AWS cloud infrastructure, with a focus on performance and scalability.
Key Responsibilities;
Database Architecture:
• Design and implement backend and reporting databases to support data decentralization and scalability.
• Define data models and schemas to optimize for performance and future growth.
• Collaborate with stakeholders to understand data requirements and translate them into efficient database solutions.
AWS Setup and Management:
• Configure and maintain AWS infrastructure for database storage and data processing.
• Implement best practices for cloud infrastructure, including security, scalability, and cost optimization.
• ETL Development and Data Pipelining:
• Develop and maintain ETL pipelines to handle raw and clean data segregation.
• Ensure seamless data flow between TrueBlue, CarbonHQ, AWS, and the reporting database.
• Monitor and optimize data pipelines for performance and reliability.
Data Integration and Migration:
• Lead the migration of data from Salesforce to CarbonHQ, ensuring data integrity and accuracy.
• Develop scalable solutions for integrating third-party applications with the backend database.
• Performance Optimization:
• Optimize database and pipeline performance to handle increasing data volumes and complex queries.
• Establish monitoring tools and implement automated processes to ensure data quality and reliability.
Does this sound like you?
• Bachelor’s or Master’s degree in Computer Science, Information Systems, or a related field.
• 4+ years of experience in data engineering, with at least 2 years in database architecture.
• Strong expertise in cloud platforms, particularly AWS (S3, RDS, Lambda, Redshift, etc.).
• Proficient in ETL tools and frameworks (e.g., Apache Airflow, Talend, or custom ETL pipelines).
• Solid understanding of SQL and NoSQL databases, data modeling, and schema design.
• Experience with data migration and integration, including APIs and third-party tools.
• Proven ability to optimize performance for large-scale data systems.
• Strong programming skills in Python, Java, or other relevant languages.
• Excellent problem-solving skills and the ability to work independently or collaboratively.
• Strong communication and collaboration skills, with the ability to work across departments and with external vendors.
• Ability to manage projects and work in a fast-paced, agile environment.
• Knowledge of reporting and analytics tools (e.g., Tableau, Power BI).
• Experience with data governance and compliance frameworks.
• Familiarity with Salesforce data structures and migrations.
• Experience working in an AWS cloud environment.
Nice to have;
• Experience with API integration and management.
• Understanding of CRM systems, preferably Salesforce.
Work Hours: 8
Experience in Months: 48
Level of Education: Bachelor Degree
Job application procedure
Click Here to apply
All Jobs
Join a Focused Community on job search to uncover both advertised and non-advertised jobs that you may not be aware of. A jobs WhatsApp Group Community can ensure that you know the opportunities happening around you and a jobs Facebook Group Community provides an opportunity to discuss with employers who need to fill urgent position. Click the links to join. You can view previously sent Email Alerts here incase you missed them and Subscribe so that you never miss out.