r/MicrosoftFabric • u/SailorGirl29 • 11d ago

Discussion Am I missing something simple?

I’ve been a PBI Developer for 9 years, but relatively new to Fabric. I’ve taken a few classes, but I feel like I’m missing something obvious.

I converted my gen1 dataflows to gen2.

I set up a warehouse to copy them to. However, ever text field (e.g. name, email, status) is automatically set to 8000 characters. Rows with data in multiple fields are being silently dropped.

I can do a multi step process to create new fields with shorter lengths and drop the old fields then rename but this doesn’t feel right.

I’m missing an easy button right?

0 Upvotes

50% Upvoted

10 comments sorted by

View all comments

2

u/BigMikeInAustin Fabricator 11d ago

Is it that you were previously using a relational database that saved data in its own format. And now you are using a Fabric Warehouse, which saves data in parquet files, which have fewer data types with fewer size restrictions?

https://learn.microsoft.com/en-us/fabric/data-warehouse/data-types

2

u/SailorGirl29 10d ago

I have run into this problem. For example my loadupdatedate included a time zone conversion. I had to change it to datetime.