Software Finder

Data Engineer

<h3>Data Engineer</h3>Software Finder is seeking skilled and motivated Data Engineers to join its growing Data Engineering team. This AWS-focused role involves building and managing data pipelines end to end, from ingestion and transformation to delivering reliable datasets that support business intelligence, analytics, and strategic decision-making.The ideal candidate will have strong SQL and Python skills, practical experience with AWS data services, and a solid understanding of data modeling and workflow orchestration. The data products developed in this role will support revenue-generating systems and business analytics, with opportunities to contribute to broader software engineering initiatives.<h4>Key Responsibilities</h4><ul><li>Design, build, deploy, and maintain scalable ETL/ELT pipelines using AWS services.</li><li>Ingest, process, and transform data from multiple source systems into the organization’s data warehouse.</li><li>Write, optimize, and maintain complex SQL queries for data transformation, modeling, reporting, and analytics.</li><li>Develop reliable data models that support business intelligence dashboards, reporting, and business analysis.</li><li>Orchestrate data workflows using Apache Airflow, AWS Step Functions, or similar technologies.</li><li>Monitor pipeline performance and data freshness, investigate failures, and implement sustainable solutions.</li><li>Collaborate with Business Intelligence teams to improve data accuracy, consistency, and reliability.</li><li>Establish effective feedback loops between Data Engineering and Business Intelligence teams to address data-quality issues.</li><li>Identify and resolve pipeline bottlenecks, data discrepancies, and recurring operational problems.</li><li>Improve pipeline scalability, performance, observability, and cost efficiency.</li><li>Apply data validation and quality-control practices throughout pipeline development and maintenance.</li><li>Use AI-assisted development tools, such as Claude Code, to support development and iteration.</li><li>Participate in code reviews and follow established software engineering and version-control standards.</li><li>Maintain clear technical documentation for data pipelines, models, workflows, and system dependencies.</li><li>Support broader backend and software engineering initiatives as business and team needs evolve.</li><li>Contribute to additional data engineering and technology-related projects as required.</li></ul><h4>Requirements</h4><ul><li>Bachelor’s degree in Computer Science, Software Engineering, Data Science, Information Technology, or a related discipline.</li><li>2–3 years of professional experience in data engineering or a backend or software engineering role involving substantial data-related work.</li><li>Strong SQL skills, including experience writing and optimizing complex queries.</li><li>Proficiency in Python for data pipeline development, automation, and data processing.</li><li>Hands-on experience with AWS data services such as Amazon S3, AWS Glue, Amazon Redshift, AWS Lambda, Amazon Athena, and Amazon EventBridge.</li><li>Practical experience with Apache Airflow or AWS Step Functions for workflow orchestration.</li><li>Strong understanding of data modeling fundamentals, including normalization and dimensional modeling.</li><li>Familiarity with Git and collaborative software development workflows.</li><li>Ability to troubleshoot data-quality issues, pipeline failures, and performance bottlenecks.</li><li>Strong analytical, problem-solving, and cross-functional communication skills.</li><li>Experience with dbt for SQL-based data transformation is preferred.</li><li>Familiarity with Terraform or other infrastructure-as-code tools is preferred.</li><li>Experience with CI/CD pipelines using GitHub Actions, AWS CodePipeline, or similar tools is preferred.</li><li>Experience with data monitoring, observability, and pipeline cost optimization is preferred.</li><li>Familiarity with AI coding assistants such as Claude Code is preferred.</li><li>Understanding of data governance, validation, and quality-control practices is preferred.</li><li>Interest in expanding into backend or broader software engineering responsibilities is preferred.</li></ul>