Skip to content

Commit 49228be

Browse files
committed
Added utils
1 parent 6105882 commit 49228be

File tree

1 file changed

+12
-0
lines changed

1 file changed

+12
-0
lines changed

utils.py

Lines changed: 12 additions & 0 deletions
Original file line numberDiff line numberDiff line change
@@ -0,0 +1,12 @@
1+
import pandas as pd
2+
3+
def load_gnad():
4+
with open('./data/10kgnad/train.csv', 'r') as fh:
5+
data = (line.split(';', 1) for line in fh)
6+
gnad_train = pd.DataFrame.from_records(data, columns=['category', 'text'])
7+
8+
with open('./data/10kgnad/test.csv', 'r') as fh:
9+
data = (line.split(';', 1) for line in fh)
10+
gnad_test = pd.DataFrame.from_records(data, columns=['category', 'text'])
11+
12+
return gnad_train, gnad_test

0 commit comments

Comments
 (0)