Pandas

SettingWithCopyWarning

When to Use

• Data Cleaning: Loading CSV/Excel/SQL and cleaning it.
• Time Series: Unmatched datetime indexing capabilities.
• Small/Medium Data: Features that fit in RAM.

Core Concepts

DataFrame / Series

Copy-on-Write (CoW)

PyArrow Backend

dtype="string[pyarrow]"

Best Practices (2025)

• Use PyArrow Strings:

  pd.options.future.infer_string = True

  (Default in 3.0).
• Use

  .query()

  : For cleaner filtering syntax.
• Migrate to CoW: Ensure your code doesn't rely on side-effects of views.

• Don't iterate rows: Use vectorization (

  df['a'] + df['b']

  ).

References

• Pandas Documentation