Back to jobs

Senior Data Engineer – AWS Data Lake & Pipeline Architecture

Toptal
Remote · Remote OK full-time
AWS SQL

<p> <strong>Headquarters:</strong> </p> <p>Summary<br>We are seeking a Data Engineer to support the development of a Data Intelligence Platform. This role focuses on data modeling, data services, data pipelines, and cloud-based data infrastructure for reporting, analytics, and data science.</p><p>General information<br>This Data Engineer will support data-related operations across a broader Data Intelligence Platform team. The work includes building and consuming web services, integrating search technologies, supporting personalization and recommendation engines, and applying data engineering best practices across the platform.</p><p>The role spans cloud-based data architecture, database performance, pipeline automation, and support for data scientists, researchers, and internal business units. The environment includes AWS-based infrastructure and a mix of structured and unstructured data sources.</p><p><strong>Tasks and Deliverables</strong><br>- Participate in the architecture design and implementation of high-performance, scalable, and optimized data solutions.<br>- Create data models from scratch using strong SQL fundamentals.<br>- Write and optimize in-application SQL statements.<br>- Ensure the performance, security, and availability of databases.<br>- Prepare documentation and technical specifications.<br>- Handle database procedures such as upgrades, backups, recovery, and migration.<br>- Profile server resource usage and optimize configurations as necessary.<br>- Design, build, and automate the deployment of data pipelines and applications.<br>- Integrate data from on-premise databases and external data sources using REST APIs and harvesting tools.<br>- Collaborate with business units and data science teams on data access, transformation, processing, and reporting needs.<br>- Support implementation, technical issues, and training related to the data lake ecosystem.<br>- Work with the team to manage AWS resources, including EMR and ECS clusters.<br>- Support

Drop your CV here or click to browse

PDF, Word (.doc/.docx), or plain text · max 10 MB