How do we deal with dataset > 30GB while working with LLama3 model

[Avi]

I tried chunking the data but still did not find any luck. so I am curious to know , how to resolve the issue.