Skip to content
GitLab
Projects
Groups
Snippets
Help
Loading...
Help
Help
Support
Community forum
Keyboard shortcuts
?
Submit feedback
Contribute to GitLab
Sign in
Toggle navigation
Open sidebar
brivas
mdf_reader
Commits
4e59e1ce
Commit
4e59e1ce
authored
5 years ago
by
iregon
Browse files
Options
Download
Email Patches
Plain Diff
Changed to pandas nullable integers management
parent
8cf8e0d8
Changes
1
Hide whitespace changes
Inline
Side-by-side
Showing
1 changed file
with
6 additions
and
6 deletions
+6
-6
common/converters.py
common/converters.py
+6
-6
No files found.
common/converters.py
View file @
4e59e1ce
...
...
@@ -37,18 +37,18 @@ class df_converters():
scale
=
scale
if
scale
else
self
.
numeric_scale
offset
=
offset
if
offset
else
self
.
numeric_offset
# First do the appropriate managing of white spaces, to the right, they mean 0!
# First do the appropriate managing of white spaces:
# to the right, they should mean 0!
data
=
data
.
replace
(
r
'^\s*$'
,
np
.
nan
,
regex
=
True
)
# str method fails if all nan
# str method fails if all nan, pd.Series.replace method is not the same
# as pd.Series.str.replace!
if
data
.
count
()
>
0
:
data
=
data
.
str
.
replace
(
' '
,
'0'
)
# Convert to numeric, then scale (?!) and give it's actual int type
data
=
pd
.
to_numeric
(
data
,
errors
=
'coerce'
)
# astype fails on strings, to_numeric manages errors....!
data
=
offset
+
data
*
scale
try
:
return
data
.
astype
(
self
.
dtype
,
casting
=
'safe'
)
except
:
return
data
return
pd
.
Series
(
data
,
dtype
=
self
.
dtype
)
def
object_to_object
(
self
,
data
,
disable_white_strip
=
False
):
# With strip() an empty element after stripping, is just an empty element, no NaN...
...
...
This diff is collapsed.
Click to expand it.
Write
Preview
Markdown
is supported
0%
Try again
or
attach a new file
.
Attach a file
Cancel
You are about to add
0
people
to the discussion. Proceed with caution.
Finish editing this message first!
Cancel
Please
register
or
sign in
to comment