Skip to content
GitLab
Projects
Groups
Snippets
Help
Loading...
Help
Help
Support
Community forum
Keyboard shortcuts
?
Submit feedback
Contribute to GitLab
Sign in
Toggle navigation
Open sidebar
brivas
mdf_reader
Commits
5578e606
Commit
5578e606
authored
5 years ago
by
iregon
Browse files
Options
Download
Email Patches
Plain Diff
New comments
parent
a956de60
Changes
3
Hide whitespace changes
Inline
Side-by-side
Showing
3 changed files
with
6 additions
and
4 deletions
+6
-4
reader/get_sections.py
reader/get_sections.py
+4
-1
reader/import_data.py
reader/import_data.py
+1
-2
reader/read_sections.py
reader/read_sections.py
+1
-1
No files found.
reader/get_sections.py
View file @
5578e606
...
...
@@ -6,7 +6,7 @@ Created on Tue Apr 30 09:38:17 2019
Splits string reports in sections using a data model layout.
Input and output are simple pandas dataframes, with the output dataframe
column names being section names
column names being
the
section names
To work with a pandas TextParser, loop through this module.
...
...
@@ -29,6 +29,9 @@ use, also support to chunking would make converting to series a bit dirty...
provided the section is in a sequential parsing_order group
@author: iregon
Have to documents the threads approach!!!!
"""
import
pandas
as
pd
...
...
This diff is collapsed.
Click to expand it.
reader/import_data.py
View file @
5578e606
...
...
@@ -6,7 +6,7 @@ Created on Fri Jan 10 13:17:43 2020
FUNCTION TO PREPARE SOURCE DATA TO WHAT GET_SECTIONS() EXPECTS:
AN ITERABLE WITH DATAFRAMES
INPUT IS
EITHER
NOW ONLY A FILE PATH
INPUT IS NOW ONLY A FILE PATH
. COULD OPTIONALLY GET OTHER TYPE OBJECTS...
OUTPUT IS AN ITERABLE, DEPENDING ON CHUNKSIZE BEING SET:
- a single dataframe in a list
...
...
@@ -38,7 +38,6 @@ OPTIONS IN OLD DEVELOPMENT:
import
pandas
as
pd
import
os
import
io
from
..
import
properties
...
...
This diff is collapsed.
Click to expand it.
reader/read_sections.py
View file @
5578e606
...
...
@@ -13,7 +13,7 @@ where appropriate and ensure its data type consistency.
Output is a dataframe with columns as follows depending on the data model
structure:
1) Data model with sections (1 or more): [(section0,element0),.......(sectionN,element
N
)]
1) Data model with sections (1 or more): [(section0,element0),.......(sectionN,element
M
)]
2) Data model with no sections[element0...element1]
...
...
This diff is collapsed.
Click to expand it.
Write
Preview
Markdown
is supported
0%
Try again
or
attach a new file
.
Attach a file
Cancel
You are about to add
0
people
to the discussion. Proceed with caution.
Finish editing this message first!
Cancel
Please
register
or
sign in
to comment