An esteemed company located in Tralee are looking for a Platform Data Engineer to join the Innovation and FinTech Lab Development Team to take part in designing, implementing, and monitoring data provision solutions. This 12-month contract offers a unique opportunity to contribute to a dynamic team and work on exciting next-generation payment technologies. Apply now to become part of this exceptional team and advance your career in data engineering.
Responsibilities:
- Design and Implementation: Design, build, and maintain batch or real-time data pipelines in production, ensuring accurate extraction, transformation, and loading of data from various sources.
- Data Infrastructure: Maintain and optimize the data infrastructure required for data extraction, transformation, and loading processes.
- ETL Development: Develop ETL processes to extract and manipulate data from multiple sources, automating data workflows for ingestion, aggregation, and ETL processing.
- Data Preparation: Prepare raw data in Data Warehouses into consumable datasets for technical and non-technical stakeholders.
- Collaboration with Data Scientists: Collaborate with data scientists to deploy machine learning models in production.
- Data Product Development: Build, maintain, and deploy data products for analytics and data science teams on cloud platforms (e.g., Azure).
- Data Accuracy and Compliance: Ensure data accuracy, integrity, privacy, security, and compliance through quality control procedures.
- Data Systems Monitoring and Optimization: Monitor data systems performance and implement optimization strategies.
- Agile Development: Participate in the Agile software development process and coordinate with other teams within your group.
- Services Differentiation and Collaboration: Identify services specific to your area of interest and collaborate with the platform team to implement and deploy shared services.
- Solution Design and Standards: Provide valuable input to design sessions to ensure that solutions are clean, secure, robust, and consistent, following the lab’s standards.
- Support and Handover: Provide support and documentation for handover to downstream development teams for further development of lab products.
Education & Skills:
- Bachelor’s Degree or higher in a software development-related discipline, information technology, computer science/engineering, etc.
- 10+ years of software development experience.
- Understanding of common patterns of enterprise software development, including Java/Spring Boot, RESTful web services, SOA, and/or Microservices, Message and Queue services (e.g., Kafka, RabbitMQ, AWS SQS, Azure Storage Queues), Swagger, Observability.
- Strong understanding of authentication and authorization concepts, including IdP (Azure AD/Okta), SAML, OAuth/OpenID, JWT, and SSO.
- Experience with containerizing applications using technologies like Docker, Docker Compose/Swarm, Kubernetes, and Helm.
- Advanced SQL skills and experience with relational databases and database design.
- Experience working with cloud Data Warehouse/Lake solutions (e.g., Azure SQL, Azure Blob Storage, Synapse, Hive).
- Experience working with data ingestion tools such as Azure Data Factory, Denodo.
- Working knowledge of Cloud-based solutions (e.g., AWS, Azure, GCP).
- Experience building and deploying machine learning models in production.
- Good understanding of NoSQL databases like Redis, Cassandra, MongoDB, or Neo4j.
- Experience with working on large data sets and distributed computing (e.g., Hive, Hadoop, Spark, Presto, MapReduce).
Duration: 12 Month Contract
If you are interested, please apply or email [email protected]
