Development and Maintenance of Data Architecture
Objective: Create and sustain a robust and scalable data architecture.
Task:
• Development of infrastructure encompassing databases, data lakes, and data warehouses.
• Maintaining of databases, data lakes and data warehouses
Recommendations for Data Storage, Retrieval, and Processing
Objective: Optimize data handling by following best practices.
Task:
• Give recommendations on implementing efficient data storage, retrieval, and processing practices.
Adoption of Data Mesh Principles
Objective: Promote decentralized data management and architecture.
Task:
• Data Mesh Implementation: Recommend strategies for adopting Data Mesh principles to encourage decentralized
data ownership and architecture.
Conceptualization and Implementation of Data Mesh Proof of Concepts (PoCs)
Objective: Validation of decentralized data architectures through practical application.
Task:
• Providing designs recommendations on decentralized data architectures
• Implementation of PoCs to validate conceptual decentralized data architectures.
Implementation of a Comprehensive Data Catalog
Objective: Enhancement of data transparency and usability.
Task
• Creation of a comprehensive data catalog documenting metadata, data lineage, and data dictionaries for all data
assets.
Profile Requirements
The contractor must be at a senior level combining a strong technical background in data engineering
with expertise in implementing data architectures, having collaboration skills, and an innovative mindset to
contribute effectively to the organization’s data strategy.
• 5+ years of general IT experience
• 3+ years of Big Data experience
• Proven experience as a Data Engineer with a focus on designing and implementing scalable data architectures.
• Extensive experience in developing and maintaining databases, data lakes, and data warehouses.
• Hands-on experience with ETL processes and data integration from various sources.
• Familiarity with modern data technologies and cloud services.
• Proficient in designing and implementing data models to meet business requirements.
• Extensive experience with Data Catalogue technology in conjunction with Data Mesh