Skip to content
GitLab
Projects
Groups
Snippets
Help
Loading...
Help
Help
Support
Community forum
Keyboard shortcuts
?
Submit feedback
Contribute to GitLab
Sign in
Toggle navigation
Open sidebar
brivas
mdf_reader
Commits
5578e606
Commit
5578e606
authored
5 years ago
by
iregon
Browse files
Options
Download
Email Patches
Plain Diff
New comments
parent
a956de60
Changes
3
Hide whitespace changes
Inline
Side-by-side
Showing
3 changed files
with
6 additions
and
4 deletions
+6
-4
reader/get_sections.py
reader/get_sections.py
+4
-1
reader/import_data.py
reader/import_data.py
+1
-2
reader/read_sections.py
reader/read_sections.py
+1
-1
No files found.
reader/get_sections.py
View file @
5578e606
...
@@ -6,7 +6,7 @@ Created on Tue Apr 30 09:38:17 2019
...
@@ -6,7 +6,7 @@ Created on Tue Apr 30 09:38:17 2019
Splits string reports in sections using a data model layout.
Splits string reports in sections using a data model layout.
Input and output are simple pandas dataframes, with the output dataframe
Input and output are simple pandas dataframes, with the output dataframe
column names being section names
column names being
the
section names
To work with a pandas TextParser, loop through this module.
To work with a pandas TextParser, loop through this module.
...
@@ -29,6 +29,9 @@ use, also support to chunking would make converting to series a bit dirty...
...
@@ -29,6 +29,9 @@ use, also support to chunking would make converting to series a bit dirty...
provided the section is in a sequential parsing_order group
provided the section is in a sequential parsing_order group
@author: iregon
@author: iregon
Have to documents the threads approach!!!!
"""
"""
import
pandas
as
pd
import
pandas
as
pd
...
...
This diff is collapsed.
Click to expand it.
reader/import_data.py
View file @
5578e606
...
@@ -6,7 +6,7 @@ Created on Fri Jan 10 13:17:43 2020
...
@@ -6,7 +6,7 @@ Created on Fri Jan 10 13:17:43 2020
FUNCTION TO PREPARE SOURCE DATA TO WHAT GET_SECTIONS() EXPECTS:
FUNCTION TO PREPARE SOURCE DATA TO WHAT GET_SECTIONS() EXPECTS:
AN ITERABLE WITH DATAFRAMES
AN ITERABLE WITH DATAFRAMES
INPUT IS
EITHER
NOW ONLY A FILE PATH
INPUT IS NOW ONLY A FILE PATH
. COULD OPTIONALLY GET OTHER TYPE OBJECTS...
OUTPUT IS AN ITERABLE, DEPENDING ON CHUNKSIZE BEING SET:
OUTPUT IS AN ITERABLE, DEPENDING ON CHUNKSIZE BEING SET:
- a single dataframe in a list
- a single dataframe in a list
...
@@ -38,7 +38,6 @@ OPTIONS IN OLD DEVELOPMENT:
...
@@ -38,7 +38,6 @@ OPTIONS IN OLD DEVELOPMENT:
import
pandas
as
pd
import
pandas
as
pd
import
os
import
os
import
io
from
..
import
properties
from
..
import
properties
...
...
This diff is collapsed.
Click to expand it.
reader/read_sections.py
View file @
5578e606
...
@@ -13,7 +13,7 @@ where appropriate and ensure its data type consistency.
...
@@ -13,7 +13,7 @@ where appropriate and ensure its data type consistency.
Output is a dataframe with columns as follows depending on the data model
Output is a dataframe with columns as follows depending on the data model
structure:
structure:
1) Data model with sections (1 or more): [(section0,element0),.......(sectionN,element
N
)]
1) Data model with sections (1 or more): [(section0,element0),.......(sectionN,element
M
)]
2) Data model with no sections[element0...element1]
2) Data model with no sections[element0...element1]
...
...
This diff is collapsed.
Click to expand it.
Write
Preview
Markdown
is supported
0%
Try again
or
attach a new file
.
Attach a file
Cancel
You are about to add
0
people
to the discussion. Proceed with caution.
Finish editing this message first!
Cancel
Please
register
or
sign in
to comment