data engineer
Posted on
November 05, 2024
by
Employer details
Princeton IT Services
Job details
*Job Title: Sr Data Engineer*
*Location:* Remote in Canada
*Type:* Full-time
*Responsibilities:*
* Design, develop, and maintain scalable data and file ingestion frameworks.
* Collaborate with cross-functional teams, analysts, and stakeholders to define data requirements and technical solutions.
* Optimize data ingestion frameworks for performance and reliability.
* Implement data governance and security best practices.
* Troubleshoot data integrity and performance issues.
* Conduct code reviews and enforce coding standards.
* Mentor junior engineers and provide guidance on complex projects.
* Participate in architectural and design discussions.
* Work on process automation to mitigate data application issues.
* Stay updated with the latest data engineering trends and technologies.
*Requirements:*
* 5-6 years of experience in data engineering with a proven track record.
* Strong SQL skills and experience with Oracle, RDBMS (PostgreSQL, Redshift, MySQL, etc.).
* 3-4 years of hands-on experience with AWS services (Redshift, S3, DynamoDB, EMR serverless, Lambdas, Step Functions, etc.).
* Experience building data pipelines with AWS and Azure.
* Proficiency in ETL development using Python, PySpark, and Big Data technologies (Hadoop, Spark).
* In-depth knowledge of data warehousing concepts, data modeling, and ETL processes.
* Excellent communication skills to explain complex technical concepts to non-technical stakeholders.
* Experience working with Agile methodologies and Scrum processes.
* Strong problem-solving skills with the ability to work independently and mentor junior developers.
* 2-3 years of experience in the financial or other highly regulated industries.
* Familiarity with JIRA, DevOps, and CI/CD best practices.
* Experience with emerging technologies like AWS QuickSight, Amazon Co-Pilot, or similar tools.
*Education:*
* Bachelor?s Degree in Computer Science, Information Systems, Mathematics, Software Engineering, or a related field.
Job Type: Full-time
Pay: $90,000.00-$100,000.00 per year
Experience:
* Data engineering: 8 years (required)
* AWS platform using, Redshift, S3, DynamoDB, Lambda: 6 years (required)
* ETL development and data modelling: 4 years (required)
* IT/ Finance industry: 3 years (required)
* Devops and CI/ CD: 3 years (required)
* azure: 6 years (required)
* strong sql skills: 5 years (required)
* Oracle: 4 years (required)
-
LocationCalgary, AB
-
Workplace information
On site
-
Salary$90,000 to $100,000YEAR annually
-
Terms of employment
Term or contractFull time
-
Starts as soon as possible
- vacancies
1 vacancy
- Source
indeed.com
#9515311798
Important notice: This job posting has been provided by a partner site. Job Bank is not responsible for this content.
Report a problem with this job posting
Thank you for your help!
You will not receive a reply. For enquiries, please contact us.