Skip to content

Woolworths Silverlayer Draft PR#263

Draft
bdl-223609704 wants to merge 3 commits into
DataBytes-Organisation:mainfrom
bdl-223609704:Woolworths-silverlayer
Draft

Woolworths Silverlayer Draft PR#263
bdl-223609704 wants to merge 3 commits into
DataBytes-Organisation:mainfrom
bdl-223609704:Woolworths-silverlayer

Conversation

@bdl-223609704
Copy link
Copy Markdown
Contributor

This PR contains edits for the Woolworths silver layer for the DE team.

  • Transform.sql has been added with the SQL transformations. This is based on the new agreed schema.
  • qa_checks.sql has been added based on the example provided.
  • job.py has been adapted for the Woolworths data.

Note: At time of request, there are expected changes from team lead. It is likely this draft will need to be revised once these changes are made.

Added transformation pipeline specific to the Woolworths data. Noting there may be some issues once DE lead publishes upcoming changes.

Signed-off-by: Rebekah De Losa <s223609704@deakin.edu.au>
Actual SQL transformations for pricings, specific to Woolworths scrape data

Signed-off-by: Rebekah De Losa <s223609704@deakin.edu.au>
As created by Ben Van.

Signed-off-by: Rebekah De Losa <s223609704@deakin.edu.au>
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant