Issues with uploaded Images

Minor · Started Apr 7, 2025 · 1:24 PM

Duration

7h 33m
Severity

Minor
Detection lead

—
User reports

—

Summary

Issues with uploaded Images

From `16:41Z` - `23:56Z` operations on and access to user uploaded images failed. This affected user ability to add new images to QR codes and Pages, and affected display of user uploaded images on Page buttons and backgrounds. The root cause was human error by our service provider during the application of a policy change. A restriction intended for one object incorrectly applied at the bucket level. We understand the significant impact this has had and we are taking steps with our service provider to prevent this from happening again.

Started

Apr 7, 2025 · 1:24 PM
Resolved

Apr 7, 2025 · 8:58 PM
Duration

7h 33m
Severity

Minor

Event timeline

How this incident unfolded

◐

Investigating
Apr 7 · 1:24 PM Bitly

We are currently investigating an issue preventing uploaded images to be fetched. This could be affecting Link in Bios and QR codes.
◐

Investigating
Apr 7 · 1:33 PM Bitly

We are continuing to investigate, this is also affecting uploading images.
◆

Identified
Apr 7 · 1:52 PM Bitly

We have identified the issue and are working to resolve it. Images are unable to be retrieved or uploaded. This may affect QR Code logos and Bitly Pages with images.
◉

Monitoring
Apr 7 · 8:01 PM Bitly

We are seeing improvement and will continue to monitor the situation.
✓

Resolved
Apr 7 · 8:58 PM Bitly

The issue has been resolved, and all services appear to be operating as expected.
✓

Postmortem
Apr 7 · 9:08 PM Bitly

From `16:41Z` - `23:56Z` operations on and access to user uploaded images failed. This affected user ability to add new images to QR codes and Pages, and affected display of user uploaded images on Page buttons and backgrounds. The root cause was human error by our service provider during the application of a policy change. A restriction intended for one object incorrectly applied at the bucket level. We understand the significant impact this has had and we are taking steps with our service provider to prevent this from happening again.