You are here: Home / Projects / OSADL QA Farm Real-time / Latency plots / 
2025-05-02 - 12:25
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of all highest latencies:
System rackeslot5.osadl.org (updated Fri May 02, 2025 00:44:21)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
17048993128,2cyclictest19837-21cron20:25:003
17048993028,1cyclictest303-21systemd-journal22:15:003
1704399300,2cyclictest27069-21idleruntime-cro00:05:012
1704399300,29cyclictest609-21dbus-daemon22:25:002
1703999300,2cyclictest21174-21cron22:45:011
1703999300,2cyclictest10522-21cron20:05:001
17048992927,1cyclictest31990-21apt-get00:15:133
1704899290,1cyclictest11584-21munin-run22:24:593
17043992927,1cyclictest4026-21perf20:59:592
17043992927,1cyclictest10921-21sendmail-msp00:40:012
1704399290,28cyclictest20437-21apt-get20:25:142
1704399290,28cyclictest10935-21apt-get23:30:152
1703899290,28cyclictest0-21swapper/023:00:140
17048992827,1cyclictest26596-21apt-get19:30:143
1704899280,0cyclictest0-21swapper/300:30:143
17043992828,0cyclictest28747-21apt-get23:00:132
17043992828,0cyclictest0-21swapper/222:30:142
17043992827,1cyclictest31574-21apt-get19:40:202
1704399280,28cyclictest21460-21apt-get22:45:132
1704399280,27cyclictest4238-21apt-get00:25:142
1703999280,28cyclictest0-21swapper/121:55:141
1703999280,28cyclictest0-21swapper/119:25:141
17038992826,1cyclictest0-21swapper/020:10:010
17048992727,0cyclictest18320-21apt-get21:30:173
17048992727,0cyclictest0-21swapper/323:10:133
17048992727,0cyclictest0-21swapper/322:25:143
17048992727,0cyclictest0-21swapper/321:45:133
17048992727,0cyclictest0-21swapper/320:25:133
17048992727,0cyclictest0-21swapper/320:05:163
1704899270,0cyclictest0-21swapper/319:45:183
1704399270,0cyclictest0-21swapper/219:45:172
17039992727,0cyclictest5989-21apt-get23:20:141
17039992727,0cyclictest27921-21apt-get21:50:141
17039992727,0cyclictest0-21swapper/123:45:151
17039992727,0cyclictest0-21swapper/122:45:131
17039992727,0cyclictest0-21swapper/119:40:201
17039992727,0cyclictest0-21swapper/119:35:021
17039992726,1cyclictest10955-21munin-run00:40:011
17038992727,0cyclictest14467-21apt-get22:30:140
17038992727,0cyclictest0-21swapper/023:30:150
17038992727,0cyclictest0-21swapper/021:15:010
17038992727,0cyclictest0-21swapper/019:30:140
17038992727,0cyclictest0-21swapper/019:10:140
17038992726,1cyclictest15464-21apt-get20:15:160
1703899270,27cyclictest0-21swapper/022:05:150
1703899270,27cyclictest0-21swapper/021:25:160
1703899270,0cyclictest0-21swapper/021:45:140
17048992626,0cyclictest0-21swapper/323:30:153
17048992626,0cyclictest0-21swapper/321:40:153
17043992626,0cyclictest0-21swapper/220:40:182
17039992626,0cyclictest0-21swapper/120:40:171
17039992626,0cyclictest0-21swapper/119:30:141
17038992626,0cyclictest0-21swapper/000:15:130
17048992525,0cyclictest0-21swapper/321:25:153
17043992525,0cyclictest0-21swapper/223:35:142
17043992525,0cyclictest0-21swapper/221:55:132
17043992525,0cyclictest0-21swapper/221:30:172
17043992525,0cyclictest0-21swapper/221:25:162
17043992525,0cyclictest0-21swapper/200:15:132
17039992525,0cyclictest0-21swapper/123:50:161
17038992525,0cyclictest0-21swapper/020:40:170
17038992525,0cyclictest0-21swapper/020:30:130
17038992525,0cyclictest0-21swapper/020:10:160
17048992424,0cyclictest13254-21apt-get23:35:133
17048992424,0cyclictest0-21swapper/300:35:143
17048992423,1cyclictest24598-21systemctl00:00:013
17048992423,0cyclictest27427-21apt-get20:40:183
17043992424,0cyclictest24275-21apt-get19:25:122
17043992424,0cyclictest0-21swapper/222:15:122
17039992424,0cyclictest7179-21apt-get22:15:131
17039992424,0cyclictest0-21swapper/123:30:151
17039992424,0cyclictest0-21swapper/122:30:141
17038992424,0cyclictest0-21swapper/023:45:160
17038992424,0cyclictest0-21swapper/023:20:140
17038992424,0cyclictest0-21swapper/020:45:170
17038992424,0cyclictest0-21swapper/020:35:120
17038992424,0cyclictest0-21swapper/020:25:000
17038992423,0cyclictest0-21swapper/022:20:130
17048992323,0cyclictest17931-21apt-get23:45:153
17048992323,0cyclictest0-21swapper/319:40:193
17043992323,0cyclictest0-21swapper/219:10:152
17043992323,0cyclictest0-21swapper/200:30:142
17039992323,0cyclictest13254-21apt-get23:35:131
17039992323,0cyclictest0-21swapper/123:00:141
17039992323,0cyclictest0-21swapper/121:10:161
17039992323,0cyclictest0-21swapper/120:30:121
17039992323,0cyclictest0-21swapper/120:25:141
17048992222,0cyclictest0-21swapper/319:20:133
17048992221,1cyclictest22759-21apt-get20:30:133
17043992222,0cyclictest15464-21apt-get20:15:152
17039992222,0cyclictest15989-21apt-get21:25:151
17039992222,0cyclictest0-21swapper/120:15:161
17039992221,0cyclictest21955-21apt-get19:20:121
17039992221,0cyclictest0-21swapper/121:40:021
17038992219,2cyclictest5614-21cron23:20:010
17048992119,1cyclictest6265-21sh00:30:013
17048992119,1cyclictest1706-21munin-run20:55:003
17043992121,0cyclictest27352-21apt-get00:05:142
17043992121,0cyclictest27352-21apt-get00:05:142
17043992121,0cyclictest0-21swapper/221:40:142
17038992121,0cyclictest0-21swapper/022:00:130
17038992120,0cyclictest19614-21apt-get19:15:130
17048992020,0cyclictest0-21swapper/320:15:163
17043992020,0cyclictest0-21swapper/220:30:122
17043992018,1cyclictest6890-21awk22:15:002
17038992020,0cyclictest0-21swapper/022:25:150
17038992019,1cyclictest29674-21chrt00:10:130
17048991919,0cyclictest0-21swapper/320:00:153
17048991918,1cyclictest2234-21perf22:05:013
17048991917,1cyclictest1-21systemd22:10:003
17043991917,1cyclictest19845-21awk20:25:002
17039991919,0cyclictest0-21swapper/122:50:141
17039991919,0cyclictest0-21swapper/120:45:161
17039991919,0cyclictest0-21swapper/100:15:131
17039991918,0cyclictest0-21swapper/121:45:141
17038991918,0cyclictest21460-21apt-get22:45:120
17043991818,0cyclictest1264-21apt-get23:10:132
17039991818,0cyclictest0-21swapper/122:25:151
17038991818,0cyclictest5902-21perf19:55:000
1703899181,10cyclictest0-21swapper/021:35:150
17048991717,0cyclictest0-21swapper/322:15:063
17048991717,0cyclictest0-21swapper/319:25:143
17043991717,0cyclictest25605-21apt-get21:45:142
17043991717,0cyclictest12146-21apt-get22:25:152
17043991717,0cyclictest0-21swapper/220:05:162
17043991717,0cyclictest0-21swapper/219:30:132
17043991715,1cyclictest29302-21sed21:50:222
17039991717,0cyclictest0-21swapper/122:00:131
17038991717,0cyclictest0-21swapper/019:35:020
17038991715,1cyclictest28423-21apt-config23:00:010
1704899163,13cyclictest0-21swapper/321:00:083
1704899163,13cyclictest0-21swapper/320:48:593
1704899160,16cyclictest0-21swapper/319:51:453
1704899160,15cyclictest20995-21if_enp1s0.823:50:193
1704899160,15cyclictest15722-21munin-run21:25:003
17043991614,1cyclictest0-21swapper/219:50:222
1704399160,15cyclictest24751-21latency_hist00:00:012
17039991614,1cyclictest626-21gdbus00:00:011
1703999160,15cyclictest8790-21munin-plugin-st21:10:011
1703899160,1cyclictest0-21swapper/000:00:010
1703899160,15cyclictest0-21swapper/021:25:000
1704899152,13cyclictest0-21swapper/322:52:083
17048991515,0cyclictest17296-21apt-get19:10:143
17048991514,0cyclictest0-21swapper/323:00:013
17048991513,1cyclictest9201-21cpuspeed_turbos21:10:163
17048991513,1cyclictest28125-21cron23:00:003
1704899150,15cyclictest0-21swapper/300:10:293
1704899150,14cyclictest9914-21sensors23:25:203
17043991514,1cyclictest10650-21users21:10:242
17043991514,1cyclictest0-21swapper/222:50:192
17043991513,1cyclictest0-21swapper/223:20:012
1704399150,1cyclictest18023-21cat23:45:152
1704399150,14cyclictest8717-21latency_hist21:10:012
1704399150,14cyclictest0-21swapper/220:45:232
17039991513,2cyclictest8641-21sed00:35:011
17039991513,1cyclictest14190-21ntp_states20:10:221
17039991513,1cyclictest0-21swapper/120:20:221
1703899155,9cyclictest1708-21apache200:23:060
17038991515,0cyclictest20249-21apt-get23:50:160
17038991513,1cyclictest8611-21apt-get23:25:130
17038991513,1cyclictest0-21swapper/021:15:110
17048991414,0cyclictest0-21swapper/321:51:283
17048991414,0cyclictest0-21swapper/320:10:503
17048991414,0cyclictest0-21swapper/319:37:143
17048991413,1cyclictest27354-21dpkg00:05:143
17048991413,1cyclictest27354-21dpkg00:05:143
1704899140,14cyclictest0-21swapper/323:06:133
1704899140,14cyclictest0-21swapper/322:45:583
1704899140,14cyclictest0-21swapper/322:37:293
1704899140,14cyclictest0-21swapper/322:30:383
1704899140,14cyclictest0-21swapper/321:56:003
1704899140,14cyclictest0-21swapper/321:39:563
1704899140,14cyclictest0-21swapper/321:05:363
1704899140,14cyclictest0-21swapper/320:55:413
1704899140,14cyclictest0-21swapper/320:35:093
1704899140,14cyclictest0-21swapper/319:55:213
1704899140,14cyclictest0-21swapper/319:17:283
1704899140,14cyclictest0-21swapper/300:20:213
1704899140,0cyclictest0-21swapper/323:40:463
1704899140,0cyclictest0-21swapper/323:20:233
1704899140,0cyclictest0-21swapper/323:15:463
1704899140,0cyclictest0-21swapper/321:15:243
1704899140,0cyclictest0-21swapper/300:01:313
17043991414,0cyclictest0-21swapper/223:25:242
17043991414,0cyclictest0-21swapper/220:36:582
17043991414,0cyclictest0-21swapper/200:20:292
17043991413,1cyclictest6165-21apt-get19:55:162
1704399140,14cyclictest0-21swapper/223:23:022
1704399140,14cyclictest0-21swapper/223:05:442
1704399140,14cyclictest0-21swapper/222:36:502
1704399140,14cyclictest0-21swapper/222:07:492
1704399140,14cyclictest0-21swapper/222:01:442
1704399140,14cyclictest0-21swapper/221:37:142
1704399140,14cyclictest0-21swapper/221:20:342
1704399140,14cyclictest0-21swapper/221:17:572
1704399140,14cyclictest0-21swapper/220:52:342
1704399140,14cyclictest0-21swapper/220:10:112
1704399140,14cyclictest0-21swapper/219:20:312
1704399140,14cyclictest0-21swapper/219:17:052
1704399140,14cyclictest0-21swapper/200:10:132
1704399140,0cyclictest0-21swapper/223:51:052
1704399140,0cyclictest0-21swapper/223:43:442
1704399140,0cyclictest0-21swapper/221:00:212
1704399140,0cyclictest0-21swapper/220:02:132
1704399140,0cyclictest0-21swapper/219:35:192
17039991414,0cyclictest0-21swapper/123:40:081
17039991414,0cyclictest0-21swapper/123:26:251
17039991414,0cyclictest0-21swapper/123:05:441
17039991414,0cyclictest0-21swapper/122:20:131
17039991414,0cyclictest0-21swapper/122:05:151
17039991414,0cyclictest0-21swapper/121:16:141
17039991414,0cyclictest0-21swapper/120:50:281
17039991414,0cyclictest0-21swapper/120:36:581
17039991414,0cyclictest0-21swapper/119:45:221
1703999140,14cyclictest0-21swapper/123:10:271
1703999140,14cyclictest0-21swapper/122:55:271
1703999140,14cyclictest0-21swapper/122:10:011
1703999140,14cyclictest0-21swapper/121:30:401
1703999140,14cyclictest0-21swapper/120:55:251
1703999140,14cyclictest0-21swapper/120:05:481
1703999140,14cyclictest0-21swapper/119:19:071
1703999140,14cyclictest0-21swapper/100:20:431
1703999140,14cyclictest0-21swapper/100:10:411
1703999140,14cyclictest0-21swapper/100:05:221
1703999140,14cyclictest0-21swapper/100:05:221
1703999140,14cyclictest0-21swapper/100:01:481
1703999140,0cyclictest0-21swapper/123:15:581
1703999140,0cyclictest0-21swapper/122:35:581
1703999140,0cyclictest0-21swapper/121:35:231
1703999140,0cyclictest0-21swapper/121:00:051
1703999140,0cyclictest0-21swapper/119:56:051
1703999140,0cyclictest0-21swapper/119:51:411
1703999140,0cyclictest0-21swapper/119:12:021
1703999140,0cyclictest0-21swapper/100:25:441
17038991414,0cyclictest0-21swapper/023:36:110
17038991414,0cyclictest0-21swapper/020:25:080
17038991414,0cyclictest0-21swapper/000:06:000
17038991414,0cyclictest0-21swapper/000:06:000
17038991413,0cyclictest0-21swapper/019:40:200
17038991412,1cyclictest1092-21sed20:50:230
1703899140,14cyclictest0-21swapper/023:40:520
1703899140,14cyclictest0-21swapper/023:10:130
1703899140,14cyclictest0-21swapper/023:05:450
1703899140,14cyclictest0-21swapper/022:50:120
1703899140,14cyclictest0-21swapper/022:40:000
1703899140,14cyclictest0-21swapper/022:36:140
1703899140,14cyclictest0-21swapper/022:15:190
1703899140,14cyclictest0-21swapper/021:55:080
1703899140,14cyclictest0-21swapper/021:05:170
1703899140,14cyclictest0-21swapper/020:55:220
1703899140,14cyclictest0-21swapper/020:00:560
1703899140,14cyclictest0-21swapper/019:55:020
1703899140,14cyclictest0-21swapper/019:45:080
1703899140,0cyclictest0-21swapper/022:12:380
1703899140,0cyclictest0-21swapper/021:50:140
1703899140,0cyclictest0-21swapper/021:30:100
1703899140,0cyclictest0-21swapper/021:00:060
1703899140,0cyclictest0-21swapper/019:20:450
1703899140,0cyclictest0-21swapper/000:36:580
1703899140,0cyclictest0-21swapper/000:31:350
1703899140,0cyclictest0-21swapper/000:27:120
1703899140,0cyclictest0-21swapper/000:00:130
17043991313,0cyclictest0-21swapper/222:56:062
1704399130,0cyclictest0-21swapper/222:40:092
17038991313,0cyclictest0-21swapper/019:25:140
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional