Skip to end of metadata
Go to start of metadata

Check this page to review the current status of IBM Mobile Push Notification services and any upcoming scheduled or emergency maintenance. To sign up for Mobile Push Notification Maintenance Notices, send an email to: xtify-status-request@unica.net with the word “subscribe” in the subject line and follow the instructions in the confirmation email.

 

System Status Date/TimeDurationDescription
UpNo planned upcoming System Maintenance    

Service Announcements

Service AffectedDate/TimeDescriptionResolved
System MaintenanceTuesday 8/16
9pm EDT
The Console UI will be offline for up to a brief period during this maintenance window. Previously scheduled campaigns will be processed. We advise clients to avoid using the Console UI during this maintenance window. Up to 15 minutes.Complete
Console MaintenanceTuesday 8/9
9pm EDT
The Console UI will be offline for up to a brief period during this maintenance window. Previously scheduled campaigns will be processed. We advise clients to avoid using the Console UI during this maintenance window. Up to 15 Minutes.Complete
Location Maintenance
Thursday 8/4 11pm EDTLocation updates will be offline for up to a brief period during this maintenance window. All other services will be available.Complete
Intermittent delays in iOS Push delivery via API and Push PointThursday July 28thWe are no longer experiencing intermittent delays with iOS push notifications deployed via API and Push Point. Apple Development App Certificates were intermittently failing upon verification with Apple. We believe this is resolved and will continue to monitor.Yes
Delay in iOS Push delivery

Thursday July 28th 12 AM EST

Currently we are observing delay in Xtify iOS push delivery because of a connection issue with APNS. Xtify operation team is actively working on this issue to resolve it as soon as possible.
Yes 9am EDT
System MaintenanceThursday July 13th - 9pm to 9:15pm EDTThe Console UI will be offline for up to a brief period during this maintenance window. Previously scheduled campaigns will be processed. We advise clients to avoid using the Console UI during this maintenance window.Complete
New registered XIDs

13th July 2016

UTC 0:00 -- 9:00

There was a registration queue back-up which prevented new registered XIDs from mapping their push tokens in time, so they were not receiving pushes until the registration queue cleared.

Note: This only impacted new registration (XIDs) and push to this XID's only would not be sent only during the impact period. However, existing XIDs continued to get push notification messages from Xtify system as normal. Operations resolved the issue.

Yes
Target Campaign SchedulerJune 30th - 8pm EDTWe have identified and resolved an intermittent issue when clients activate a Target Campaign which includes the Schedule rule. In intermittent cases, the Schedule does not get set properly. Operations has now resolved this.Yes
Bulk API and Push Point Incident8pm EST June 28th to 11:30am EST June 29thDuring this period, customers may have seen intermittent errors when trying to communicate with the Bulk API or use Push Point. Operations has resolved. Engineering is still investigating the details.Yes
API's and Push Point IncidentJune 28th -
3pm to 4pm EDT
During this period, customers may have seen push delays or a small portion of lost push notifications sending from API's or Push Point. Operations has resolved.Yes
System MaintenanceThursday June 23rd - 9 PM to 9:15 PM EDTThe Console UI will be offline for up to a brief period during this maintenance window. Previously scheduled campaigns will be processed. We advise clients to avoid using the Console UI during this maintenance window.Complete
Intermittent API Errors - Push 2.0 API & Single Push API - Rich Content6/14/2016Updated: API users may experience intermittent 500 level errors when trying to call and send Rich Inbox content via the Push API 2.0 (api.xtify.com/2.0/push) and the Single Push API. Operations is working quickly to identify and resolve the intermittent errors.Yes
Incident & Maintenance -
Application Metrics
Monday June 13th - 9 PM to 9:15 PM EST

Incident: We have identified an issue with the Application Metrics report. Operations has also identified a resolution and we will need to restart Xtify Console UI services tonight in order to complete the resolution.

Resolution Maintenance: The Xtify Console UI will be offline for a brief period during this period. Previously scheduled campaigns will be processed. We advise clients to avoid using the Console UI during this maintenance window.

Yes
Incident - Push Point UI6/7/2016We experienced a brief issue with the Push Point UI. The Push Point 'send' button became unresponsive for a brief period.Yes
Incident - Adding New Locations6/1/2016We had identified an issue with the creation of new locations in our UI. Current locations and associated campaigns were unaffected. Engineering completed resolution.Yes
Location Services5/27/2016 approx. 2:30 PM ESTWe experienced an issue which impacted location-based notifications. Location-triggered notifications using the Xtify location API would not have been processed, which impacted most location updates and location-based pushes during this timeframe. This issue is resolved.5/27/2016 approx. 4:30 PM EST

UPDATE COMPLETED:

Apple Push Certificate Change

4/27/2016

We have deployed implementation changes that are required to automatically process net-new Apple Push Certificates after clients enter their new .p12 certificate file into IBM Mobile Customer Engagement (Xtify).

If you have any questions, please submit a ticket with Support via the Client Success Portal (https://support.ibmcloud.com) or by emailing IBMMobileEngage@us.ibm.com.

Completed
May 11th

Minor System Maintenance5/10 - 9 PM to 9:15 PM EDTThe Console UI will be offline for up to a brief period during this maintenance window. Previously scheduled campaigns will be processed. We advise clients to avoid using the Console UI during this maintenance window.Complete
Minor System Maintenance5/3 - 9 PM to 9:15 PM EDTThe Console UI will be offline for up to a brief period during this maintenance window. Previously scheduled campaigns will be processed. We advise clients to avoid using the Console UI during this maintenance window.Complete
Major System Maintenance

Saturday June 11th
11 PM EDT to
Sunday June 12th at
5 AM EDT

(Sunday June 12th
3 AM GMT to
9 AM GMT)

We will be using the maintenance window for IBM Mobile Customer Engagement (Xtify) US to migrate the application to an IBM SoftLayer cloud data center. This impacts all customers who utilize any of the Xtify services (via https://console.xtify.com including API's).

The Xtify service will NOT be available during the maintenance window. New and previously scheduled campaigns will NOT execute during the maintenance window, so be sure to schedule your campaigns to begin and end outside this time frame. During this maintenance, reporting data will also be unavailable. All system functionality will be restored once the migration has been completed and verified.

If you would like to discuss this maintenance with IBM, please submit a ticket with Support via the Client Success Portal (https://support.ibmcloud.com) or by emailing ibmmobileengage@us.ibm.com.  

Complete
System Maintenance4/19 - 9 PM to 9:30 PM EDTThe Console UI will be offline for up to a brief period during this maintenance window. Previously scheduled campaigns will be processed. We advise clients to avoid using the Console UI during this maintenance window.Complete
Action Required - System Maintenance4/12 - 9 PM to 9:30 PM EST

The Console UI will be offline for up to a brief period during this maintenance window. Previously scheduled campaigns will be processed. We advise clients to avoid using the Console UI and avoid scheduling new campaigns during this maintenance window. Please note the following:

Action Required:
In our efforts to continually improve security, our latest security update will impact your password. Starting Tuesday April 12th at 9pm EDT, if you have not changed your password in the last 90 days, you will need to use the 'Forgot Password' button on the Xtify Console login page to generate a temporary password sent via email. Then login to the Xtify Console with the temp password and you'll be prompted to update your password based on the requirements below.

1.    Minimum length is 8, maximum length is 24.
2.    Your last 3 passwords cannot be used.
3.    No dictionary words can be used.

Passwords expire every 90 days.

If you wish to change your password before the changes go into effect, login to the Xtify Console, at the top of the page click on Account Settings, and from the Account Settings page you can change your password.

Complete
System Maintenance4/5 - 11 PM to 11:30 PM EDT

Services will be temporarily degraded due to a security update during this 1/2 hour maintenance. We would advise to schedule campaigns outside of this window. Campaigns which are not complete when the maintenance begins may potentially be dropped. Calls to API's during this time period may be delayed or dropped.

Complete
System Maintenance3/24 - 9 PM to 9:30 PM ESTThe Console UI will be offline for a brief period during this minor maintenance window. Previously scheduled campaigns will be processed. We advise clients to avoid using the Console UI during this maintenance window.Complete
Major System MaintenanceCANCELED - Saturday March 19th
10 AM to 4 PM EST

The Xtify system maintenance originally scheduled for Saturday March 19th 2016 has been canceled, and will be rescheduled for a future date.

Please be on the lookout for more information in the coming weeks. We apologize for any inconvenience.
CANCELED
System Maintenance3/15 - 9 PM to 9:15 PM ESTThe Console UI will be offline for a brief period during this minor maintenance window. Previously scheduled campaigns will be processed. We advise clients to avoid using the Console UI during this maintenance window.Complete
System Maintenance2/4 - 9:00 PM to 9:30 PM EST

The Console UI will be offline for a brief period during this minor maintenance window. Previously scheduled campaigns will be processed. We advise clients to avoid using the Console UI during this maintenance window.

Complete
Tags, Registration, Stats, Push1/25 - 7pm to 11pm EST

We experienced intermittent errors from 7pm EST to 11pm EST on calls to API's which impacted Registrations, Tag Updates, Push messaging. Metrics during 10-11PM EST would not have been recorded, all other metrics were processed successfully.

This was resolved at 11pm last night.

Yes
System Maintenance1/19 - 9:00 PM EST  to 9:15 PM ESTThe Console UI will be offline for a brief period during this minor maintenance window. Previously scheduled campaigns will be processed. We advise clients to avoid using the Console UI during this maintenance window.Complete
System Maintenance12/10 - 10:00 PM EST  10:15 PM EST

The Console UI will be offline for a brief period during this maintenance window to release a new feature enabling users to view campaigns in Read Only mode (new icon in Target next to the Campaign Edit icon). Previously scheduled campaigns will be processed. We advise clients to avoid using the Console UI during this maintenance window.

For more information on this feature, please read: https://developer.ibm.com/push/view-campaigns-without-deactivating/

Complete
Push Delays11/30 10:00 PM EST - 12/1 3:00 AM EST

Customers may have seen delays with sending push notifications. Push campaigns sent via Target were not impacted.

Operations resolved this issue.

Yes
Tags, Registration, Stats, Push Delays11/26 6:45 PM EST - 7:20 PM EST

Customers may have seen delays with campaigns using xid validation, including push notifications, metric processing, tag updates, registrations.

Operations resolved this issue and messages are processing.

Yes
Tags, Registration, Stats, Push Delays11/26 1 PM EST - 1:40 PM EST

Customers may have seen delays with campaigns using xid validation, including push notifications, metric processing, tag updates, registrations.

Operations resolved this issue.

Yes
Tags, Registration, Stats, Push Delays11/25/2015 12:30 PM to 1:30 PM EST

We have identified a potential delay in the following services: Tags, Registration, Stats. Operations is investigating and working toward a resolution.

Yes
Push delays11/24/2015 approx 1:15 PM EST -  approx 3pm EST.

Earlier this afternoon, we experienced exceptional queue build up and some customers using Target may have seen slow or delayed push notifications. This has been resolved and messages are without delay.

Yes
Tags, Registration, Stats, Push Delays11/23/2015 3:05 PM to 5:00 PM EST

We have identified a potential delay and/or errors in the following services: Tags, Registration, Stats. You may see delays in push notifications. Operations is working toward a resolution. 

Yes
API - UI Push11 18 2015, Time : 22:48 UTC - 02:00 UTCRequests to our api services for 2.1/notification would have resulted in partial 500 errors.Yes
Target Campaign Editing11/5/2015 to 11/6/2015We identified an issue in which customers may experience an error when editing new and existing campaigns. Operations is working to identify a resolution.Yes
System Maintenance11/5/2015 9:00 PM EST to 9:30 PM ESTThe Console UI and notification sending services will be offline for a brief period during this maintenance window. Previously scheduled campaigns will be processed, but they may be delayed during this period. We advise clients to avoid using the Console UI and avoid scheduling new campaigns during this maintenance window.Complete
System Maintenance

11/3/2015 11:00 PM EST to 11:15 PM EST

The Console UI will be offline for up to a brief period during this maintenance window. Previously scheduled campaigns will be processed. We advise clients to avoid using the Console UI and avoid scheduling new campaigns during this maintenance window.

Complete
Reporting Metrics10/31/2015 to 11/2/2015

We experienced an issue that impacted the populating the reporting metrics in the Console UI. Operations identified and implemented a resolution, no data was lost, and reporting metrics are corrected.

Yes
API - UI Push10/23/2015 to 10/26/2015

We experienced an issue that impacted connections to the UI Push API. Messages sent during this time would not have been processed. Operations identified and implemented and resolved this issue. No other services were impacted.

Yes
Location - Updates & Sending10/23/2015 1:23 PM to 3:23 PM ESTWe experienced a brief interruption that impacted location-triggered push messages only, based on an issue with location updates. Operations identified and implemented a resolution.Yes
Xtify Console Refresh

10/22/2015 9:00 PM to 9:15 PM EST

As part of holiday upgrades, the Console will be offline for up to 15 minutes for a refresh. Scheduled campaigns will be delayed to after this time period. We advise clients to avoid using the Console UI and avoid scheduling new campaigns during this maintenance window. No other services will be impacted.Complete
System Maintenance

10/15/2015 9:00 PM to 9:15 PM EST

(Required by Amazon Web Services)
The MCE Xtify Console UI will be offline for up to 10 minutes for required maintenance.
Complete
Location - Updates & Sending10/9 4:30 PM EST to 10/12 5:00 PM ESTWe experienced an issue that impacted the location updates and sending push messages specifically and only based on geo-location. Operations identified and implemented a resolution.Yes
Registration10/6/2015 to 10/7/2015

We have identified an potential issue that may be impacting some initial device registrations and assignment of an XID on existing devices attempting to re-register for the service. Operations is currently investigating.

RESOLVED: Hotfix applied on 10/7. Devices in this time period would have re-registered after next app open.

Yes
Location Updates10/3/2015

Summary: Push campaigns will launch as expected and messages are delivered without delays.

 In working to address some intermittent issues, we have temporarily disabled location updates.

-For location, mobile device location will not be updated from last known location until we resume the service.

At approximately 12 pm EST OCT 4, Operations re-enabled location updates for mobile devices and is processing updates.

Yes
System Maintenance10/3/2015All services will be impacted with an upgrade to the database during this maintenance. Please schedule and send campaigns outside of this time period. Existing campaigns will be sent after the maintenance has been performed. API push users should note that API push calls will also be impacted and should avoid pushing during this period.Complete
Labels: