Data Engineer Intern
Responsabilități:
Database Migration from Oracle to Postgres using Kafka Streaming and Debezium Change Data
Capture
• Created and administrated databases in Oracle and Postgres: user control access, from diagram to
SQL code, Oracle to Postgres conversion, backup/restore.
• Implemented Bash scripts to export Oracle DB tables into CSV files and copy them to an AWS S3
bucket folder.
• Implemented procedures, functions, views, and triggers in Postgres and Oracle.
• Implemented Python scripts to populate Oracle DB with dummy data, exporting and migrating it
from AWS S3 to Postgres; **Repository: https://github.com/viggleUnik/Data_Migration.git.
• Configured, created a Kafka Cluster, and tested its functionality.
• Used Debezium Connector for Oracle and JDBC Sink to create source and sink connectors.