You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-06-17 - 05:15
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the 376 highest latencies:
System rack5slot3.osadl.org (updated Wed Jun 17, 2026 00:56:23)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
5509982258,84cyclictest0-21swapper/422:03:004
550998071,803cyclictest30963-21/usr/sbin/munin00:40:234
550997250,126cyclictest121rcu_preempt22:40:054
5509971174,634cyclictest0-21swapper/423:18:564
547996781,3cyclictest0-21swapper/100:39:071
547996781,3cyclictest0-21swapper/100:39:071
5509967234,507cyclictest0-21swapper/400:31:564
5509965964,84cyclictest0-21swapper/422:21:244
5479964898,126cyclictest0-21swapper/122:05:161
5479964898,126cyclictest0-21swapper/122:05:161
546996413,465cyclictest11651-21kworker/u16:300:24:510
550996371,505cyclictest0-21swapper/422:39:444
550996351,467cyclictest0-21swapper/400:39:074
550996351,467cyclictest0-21swapper/400:39:074
55299629118,508cyclictest0-21swapper/600:06:286
55299629118,508cyclictest0-21swapper/600:06:286
55299629118,508cyclictest0-21swapper/600:06:286
54999616105,254cyclictest0-21swapper/322:36:203
55199597129,380cyclictest121rcu_preempt23:41:125
548995970,128cyclictest0-21swapper/200:23:132
550995951,591cyclictest0-21swapper/400:01:284
547995952,3cyclictest0-21swapper/100:01:201
553995940,84cyclictest0-21swapper/722:02:017
552995940,84cyclictest0-21swapper/600:38:456
552995940,84cyclictest0-21swapper/600:38:456
551995940,84cyclictest0-21swapper/523:05:175
549995940,84cyclictest0-21swapper/323:05:173
548995940,84cyclictest0-21swapper/223:05:172
548995940,84cyclictest0-21swapper/200:36:132
548995940,84cyclictest0-21swapper/200:36:132
55299590119,212cyclictest1551-21snmpd23:42:026
5539958376,83cyclictest121rcu_preempt23:20:307
5509958232,42cyclictest0-21swapper/400:06:184
5509958232,42cyclictest0-21swapper/400:06:184
5509958232,42cyclictest0-21swapper/400:06:184
5509957624,549cyclictest0-21swapper/422:25:074
55199572106,84cyclictest121rcu_preempt22:16:555
55399567523,41cyclictest711rcuc/700:36:047
55399567523,41cyclictest711rcuc/700:36:047
5509956613,550cyclictest0-21swapper/422:18:324
5509956455,507cyclictest0-21swapper/400:23:394
5469956453,253cyclictest9-21ksoftirqd/022:24:330
550995618,550cyclictest0-21swapper/423:52:014
54999560180,254cyclictest0-21swapper/300:39:073
54999560180,254cyclictest0-21swapper/300:39:073
550995564,549cyclictest0-21swapper/423:27:124
550995541,550cyclictest0-21swapper/423:05:194
5489955240,339cyclictest0-21swapper/222:03:322
551995512,340cyclictest0-21swapper/500:39:075
551995512,340cyclictest0-21swapper/500:39:075
55399548504,41cyclictest711rcuc/722:24:137
54899548121,211cyclictest0-21swapper/222:15:542
54699546501,42cyclictest111rcuc/022:38:460
5469954536,3cyclictest0-21swapper/023:27:110
5469954274,295cyclictest0-21swapper/000:02:070
55299539283,126cyclictest0-21swapper/623:29:526
5529953665,296cyclictest0-21swapper/622:16:216
5489953569,84cyclictest131rcu_sched23:30:002
5489953018,381cyclictest0-21swapper/223:30:192
5519952918,84cyclictest0-21swapper/522:04:135
5509952919,507cyclictest0-21swapper/423:41:494
5509952819,507cyclictest0-21swapper/422:05:164
5509952819,507cyclictest0-21swapper/422:05:164
5519952455,337cyclictest0-21swapper/523:17:215
5519952315,84cyclictest0-21swapper/500:02:075
5489952117,293cyclictest0-21swapper/222:46:312
55399520136,381cyclictest0-21swapper/700:06:287
55399520136,381cyclictest0-21swapper/700:06:287
55399520136,381cyclictest0-21swapper/700:06:287
5519952015,252cyclictest0-21swapper/500:06:155
5519952015,252cyclictest0-21swapper/500:06:155
5519952015,252cyclictest0-21swapper/500:06:155
5479952013,126cyclictest0-21swapper/100:10:001
5479952013,126cyclictest0-21swapper/100:10:001
5479952013,126cyclictest0-21swapper/100:09:591
549995145,127cyclictest0-21swapper/322:05:163
549995145,127cyclictest0-21swapper/322:05:163
549995132,211cyclictest41-21ksoftirqd/322:17:403
553995090,84cyclictest0-21swapper/723:19:497
547995090,84cyclictest0-21swapper/100:24:091
5469950940,3cyclictest0-21swapper/000:37:040
5469950940,3cyclictest0-21swapper/000:37:040
5479950840,3cyclictest0-21swapper/123:17:161
55299507124,380cyclictest0-21swapper/623:17:366
55099507167,337cyclictest187-21md0_raid123:00:254
5479950781,210cyclictest0-21swapper/122:17:401
552995062,45cyclictest14766-21ssh22:23:206
5489950541,3cyclictest0-21swapper/200:01:332
54899505121,211cyclictest0-21swapper/221:43:042
5469950539,85cyclictest121rcu_preempt22:02:000
54699505122,380cyclictest0-21swapper/023:17:360
5519950436,337cyclictest0-21swapper/522:22:355
5539950338,3cyclictest0-21swapper/723:30:167
5519950334,211cyclictest57-21ksoftirqd/522:40:015
5539950236,126cyclictest121rcu_preempt22:38:537
5509950133,465cyclictest0-21swapper/423:30:154
5479950133,211cyclictest25-21ksoftirqd/122:03:561
5489949977,84cyclictest0-21swapper/222:36:342
54799497113,211cyclictest7999-21diskmemload23:42:021
5509949670,423cyclictest0-21swapper/422:46:034
5509949528,464cyclictest0-21swapper/422:55:464
5489949472,84cyclictest0-21swapper/223:51:232
5539949328,211cyclictest73-21ksoftirqd/723:25:237
5479949325,84cyclictest0-21swapper/121:44:371
5469949327,126cyclictest0-21swapper/022:17:580
5499949169,84cyclictest0-21swapper/323:16:143
5529949024,126cyclictest0-21swapper/622:02:386
5499949021,338cyclictest0-21swapper/300:21:163
54799490446,41cyclictest241ktimersoftd/122:56:471
5519948819,466cyclictest0-21swapper/521:44:345
5479948820,2cyclictest0-21swapper/122:39:411
55199486144,211cyclictest16566-21kworker/5:223:28:195
5489948621,3cyclictest0-21swapper/222:56:512
5469948519,126cyclictest0-21swapper/000:25:250
5519948462,84cyclictest0-21swapper/523:51:235
5499948459,296cyclictest0-21swapper/323:26:443
5479948499,169cyclictest0-21swapper/123:29:221
5539948316,84cyclictest0-21swapper/722:16:537
5499948159,256cyclictest7999-21diskmemload22:40:073
5489947998,84cyclictest0-21swapper/223:16:562
5519947814,253cyclictest18249-21sshd00:31:285
5499947755,84cyclictest0-21swapper/300:09:053
5499947755,84cyclictest0-21swapper/300:09:053
5499947755,84cyclictest0-21swapper/300:09:053
5469947751,211cyclictest9-21ksoftirqd/000:31:040
5529947413,416cyclictest0-21swapper/622:36:076
5509947410,253cyclictest0-21swapper/421:44:304
54699474132,84cyclictest131rcu_sched22:05:100
54699474132,84cyclictest131rcu_sched22:05:100
551994735,465cyclictest0-21swapper/522:46:475
5519947043,211cyclictest16769-21df_abs22:25:195
548994681,84cyclictest121rcu_preempt23:00:182
5489946744,257cyclictest8512-21kworker/u16:122:40:072
5539946681,127cyclictest0-21swapper/700:24:367
55299466123,340cyclictest0-21swapper/600:01:106
5479946642,126cyclictest25-21ksoftirqd/123:51:401
54899465124,338cyclictest0-21swapper/223:41:282
5479946541,42cyclictest121rcu_preempt22:30:191
5509946438,423cyclictest19086-21ssh23:20:074
5509946341,341cyclictest0-21swapper/423:35:224
5499946340,257cyclictest0-21swapper/323:41:453
54699463122,338cyclictest0-21swapper/021:42:380
54899462122,338cyclictest0-21swapper/222:20:102
54799462378,42cyclictest241ktimersoftd/122:46:371
5469946240,3cyclictest0-21swapper/000:05:310
5469946240,3cyclictest0-21swapper/000:05:310
5469946240,3cyclictest0-21swapper/000:05:310
5479946134,92cyclictest121rcu_preempt23:30:191
5479946034,169cyclictest25-21ksoftirqd/122:22:071
55299458117,126cyclictest0-21swapper/623:30:226
5479945875,380cyclictest7999-21diskmemload23:05:171
5539945735,46cyclictest121rcu_preempt00:01:157
5519945734,256cyclictest0-21swapper/500:24:185
5509945773,211cyclictest6647-21grep00:25:254
5499945735,256cyclictest0-21swapper/322:20:213
5489945777,84cyclictest0-21swapper/200:09:052
5489945777,84cyclictest0-21swapper/200:09:052
5489945777,84cyclictest0-21swapper/200:09:052
5479945732,126cyclictest0-21swapper/123:35:221
5479945677,295cyclictest0-21swapper/100:31:321
5539945571,381cyclictest0-21swapper/722:05:167
5539945571,381cyclictest0-21swapper/722:05:167
5529945576,84cyclictest0-21swapper/600:31:516
5499945570,211cyclictest401ktimersoftd/322:04:353
5489945575,84cyclictest0-21swapper/200:31:322
55199454113,338cyclictest8092-21sh22:38:355
5499945475,81cyclictest0-21swapper/322:46:453
54899454155,126cyclictest6637-21gzip00:25:252
5529945228,258cyclictest0-21swapper/600:21:286
55299451108,340cyclictest0-21swapper/622:56:526
5479945129,126cyclictest121rcu_preempt00:25:151
5469945130,84cyclictest544-21cyclictest22:56:350
54699451111,338cyclictest0-21swapper/023:52:070
5529945070,84cyclictest0-21swapper/623:51:236
55199450109,338cyclictest5532-21ssh00:25:155
5539944621,84cyclictest0-21swapper/700:32:137
5539944565,84cyclictest0-21swapper/721:42:267
55199445151,122cyclictest121rcu_preempt23:00:195
5499944523,210cyclictest0-21swapper/322:56:103
5529944422,260cyclictest0-21swapper/621:42:516
54999443106,171cyclictest0-21swapper/321:44:303
5529944262,43cyclictest9364-21taskset22:40:116
5539944199,339cyclictest0-21swapper/723:00:237
55399440141,126cyclictest121rcu_preempt23:52:077
5519943917,253cyclictest0-21swapper/522:05:225
5519943917,253cyclictest0-21swapper/522:05:225
5469943997,126cyclictest121rcu_preempt23:20:310
55399438181,254cyclictest721ktimersoftd/722:46:507
5499943858,84cyclictest0-21swapper/300:31:513
5499943411,3cyclictest0-21swapper/323:00:193
5539943352,84cyclictest0-21swapper/722:40:157
5529943295,85cyclictest0-21swapper/622:45:556
5479942948,126cyclictest25-21ksoftirqd/122:25:201
5469942889,134cyclictest0-21swapper/022:46:530
5499942788,84cyclictest0-21swapper/300:40:253
54999427131,212cyclictest11431-1kworker/u17:023:51:023
5499942582,211cyclictest32113-21ssh00:02:113
5489942451,248cyclictest0-21swapper/222:25:192
54699424124,127cyclictest9-21ksoftirqd/000:40:170
5519942383,338cyclictest0-21swapper/522:56:525
5509942382,338cyclictest0-21swapper/422:30:194
5489942339,381cyclictest0-21swapper/222:05:162
5489942339,381cyclictest0-21swapper/222:05:162
546994231,256cyclictest0-21swapper/023:00:190
5529942237,382cyclictest0-21swapper/622:05:166
5529942237,382cyclictest0-21swapper/622:05:166
5519942281,338cyclictest0-21swapper/523:30:205
5469942234,211cyclictest0-21swapper/023:41:450
5479942180,338cyclictest0-21swapper/100:40:071
5479942180,211cyclictest25-21ksoftirqd/122:40:141
5499942081,84cyclictest0-21swapper/322:30:213
5529941983,171cyclictest0-21swapper/623:00:196
5519941939,295cyclictest0-21swapper/523:20:125
5539941677,253cyclictest0-21swapper/723:41:087
5529941677,84cyclictest0-21swapper/623:05:186
5519941636,296cyclictest0-21swapper/523:35:215
5469941535,3cyclictest0-21swapper/023:05:150
5539941169,339cyclictest0-21swapper/722:56:247
5519941172,84cyclictest0-21swapper/500:40:075
5499941172,84cyclictest0-21swapper/322:25:133
5489941071,84cyclictest0-21swapper/200:40:162
5519940969,84cyclictest27928-21kworker/u16:222:30:195
5469940969,337cyclictest0-21swapper/021:45:110
5469940929,211cyclictest0-21swapper/022:25:090
5479940867,338cyclictest0-21swapper/123:20:321
54899407107,169cyclictest27552-21ssh22:30:182
5479940767,337cyclictest0-21swapper/123:00:201
5539940423,3cyclictest16805-21df_abs22:25:217
5519940467,84cyclictest0-21swapper/521:45:115
54699404274,84cyclictest0-21swapper/022:30:190
5539940261,85cyclictest0-21swapper/700:40:257
5529940263,84cyclictest0-21swapper/600:40:256
5499940061,84cyclictest0-21swapper/323:35:213
5469939960,84cyclictest0-21swapper/023:30:080
54999396185,42cyclictest41-21ksoftirqd/300:25:253
5499939511,211cyclictest41-21ksoftirqd/323:30:203
5469939455,84cyclictest0-21swapper/022:40:070
5529939354,84cyclictest27554-21missed_timers22:30:216
5509939254,84cyclictest0-21swapper/421:45:114
5539938038,127cyclictest0-21swapper/721:45:087
54899379122,126cyclictest19105-21apt-get23:20:122
5469937740,3cyclictest0-21swapper/023:35:220
5539937532,254cyclictest0-21swapper/700:25:297
5539937334,84cyclictest0-21swapper/722:30:217
5529937131,84cyclictest0-21swapper/600:25:256
5499937073,84cyclictest0-21swapper/321:45:113
5509936832,334cyclictest0-21swapper/400:10:124
5539936425,84cyclictest26185-21ssh23:05:207
5499936320,211cyclictest0-21swapper/323:20:303
55299355100,125cyclictest0-21swapper/623:20:126
5529935194,254cyclictest0-21swapper/622:25:206
5489935055,171cyclictest303-21systemd-journal00:10:092
5539934911,171cyclictest0-21swapper/723:35:237
5479933175,253cyclictest0-21swapper/121:45:111
5499932732,85cyclictest0-21swapper/300:10:123
5479932731,3cyclictest0-21swapper/100:10:081
5489932269,86cyclictest7999-21diskmemload23:35:232
5519931624,207cyclictest0-21swapper/500:10:085
5529931216,169cyclictest0-21swapper/621:45:116
5529931116,211cyclictest0-21swapper/623:35:216
5469930910,126cyclictest0-21swapper/000:10:090
5489930346,254cyclictest0-21swapper/221:45:082
553992961,172cyclictest0-21swapper/700:10:097
5529926816,41cyclictest121rcu_preempt00:10:096
3069329063,4sleep50-21swapper/519:05:135
3253528655,28sleep30-21swapper/319:09:283
3244728546,36sleep10-21swapper/119:08:141
3244328545,36sleep60-21swapper/619:08:116
3241028542,39sleep00-21swapper/019:07:410
3257328251,28sleep20-21swapper/219:09:592
3235128251,27sleep70-21swapper/719:06:517
3239527846,28sleep40-21swapper/419:07:294
138762680,0sleep70-21swapper/721:12:037
551992910,18cyclictest0-21swapper/519:40:035
551992810,18cyclictest0-21swapper/519:39:595
551992810,17cyclictest0-21swapper/519:13:185
550992710,17cyclictest0-21swapper/419:39:424
549992727,0cyclictest0-21swapper/319:39:443
549992727,0cyclictest0-21swapper/319:13:213
548992727,0cyclictest0-21swapper/219:13:212
548992710,17cyclictest0-21swapper/219:40:012
547992710,17cyclictest0-21swapper/119:39:591
547992710,0cyclictest0-21swapper/119:13:171
546992727,0cyclictest0-21swapper/019:39:370
546992727,0cyclictest0-21swapper/019:13:150
26272270,1sleep70-21swapper/721:39:117
553992626,0cyclictest0-21swapper/719:40:027
553992626,0cyclictest0-21swapper/719:39:377
553992626,0cyclictest0-21swapper/719:13:167
552992626,0cyclictest0-21swapper/619:40:016
550992626,0cyclictest0-21swapper/419:13:214
55099261,23cyclictest0-21swapper/421:35:174
548992626,0cyclictest0-21swapper/219:39:352
546992626,0cyclictest0-21swapper/019:40:020
552992525,0cyclictest0-21swapper/619:39:596
60662240,0sleep60-21swapper/621:57:256
552992424,0cyclictest0-21swapper/619:13:276
549992424,0cyclictest0-21swapper/319:40:033
547992424,0cyclictest0-21swapper/119:40:001
324552240,0sleep40-21swapper/422:12:054
55199230,16cyclictest6235-21ssh21:57:325
55199229,9cyclictest0-21swapper/521:38:335
55199220,17cyclictest0-21swapper/519:16:145
55199219,9cyclictest0-21swapper/521:30:495
55199216,12cyclictest8536-21chrt23:12:375
551992110,8cyclictest0-21swapper/522:50:245
55199210,17cyclictest1783-21ssh21:22:075
55199210,17cyclictest1783-21ssh21:22:075
550992121,0cyclictest0-21swapper/419:40:014
55199208,7cyclictest6008-21sh23:48:365
55199207,10cyclictest9761-21taskset19:20:525
551992010,8cyclictest0-21swapper/519:27:015
551992010,7cyclictest0-21swapper/522:10:525
55199200,16cyclictest29478-21ssh21:53:115
55199200,16cyclictest23437-21ssh21:16:425
55199200,14cyclictest26661-21ssh00:17:485
55199200,14cyclictest14918-21ssh21:12:445
55199200,13cyclictest24755-21chrt19:46:545
55199198,9cyclictest8974-21which20:15:145
55199190,15cyclictest27318-21netstat20:45:175
55199190,12cyclictest6597-21processes20:10:205
55199190,12cyclictest31118-21chrt20:50:545
35962190,0sleep30-21swapper/321:55:463
310212190,0sleep70-21swapper/720:50:247
55199189,7cyclictest0-21swapper/520:23:565
55199188,9cyclictest17997-21grep23:55:125
55199183,9cyclictest25582-21expr19:50:115
55199182,10cyclictest14165-21cat20:25:125
55199180,15cyclictest20691-21/usr/sbin/munin20:35:145
55199180,10cyclictest0-21swapper/521:25:225
55199180,10cyclictest0-21swapper/519:35:005
23172180,0sleep60-21swapper/622:13:356
55199173,12cyclictest2025-21basename21:00:005
55199170,10cyclictest1373-21taskset20:02:355
55299161,7cyclictest65-21ksoftirqd/600:20:006
55199167,8cyclictest2816-21expr21:00:105
55199160,9cyclictest6944-21ntp_states21:05:195
55199160,9cyclictest0-21swapper/520:09:495
55199160,14cyclictest24405-21ntp_states20:40:205
55199160,10cyclictest0-21swapper/519:56:275
54999164,7cyclictest131rcu_sched21:35:153
553991513,1cyclictest0-21swapper/721:50:127
55199151,12cyclictest17487-21df_abs20:30:135
54999151,7cyclictest41-21ksoftirqd/322:55:003
54999150,14cyclictest0-21swapper/320:01:463
54899151,9cyclictest33-21ksoftirqd/220:05:002
54799151,13cyclictest0-21swapper/121:39:421
546991510,3cyclictest16179-21basename21:30:010
553991412,1cyclictest22852-21ssh21:32:457
55099149,4cyclictest30137-21grep21:20:154
55099149,4cyclictest30137-21grep21:20:154
550991412,1cyclictest49-21ksoftirqd/421:53:114
550991412,1cyclictest481ktimersoftd/423:58:174
550991412,1cyclictest11656-21fschecks_count20:20:144
550991411,2cyclictest481ktimersoftd/420:25:144
550991411,2cyclictest481ktimersoftd/420:20:014
550991411,1cyclictest0-21swapper/422:51:344
54999140,13cyclictest0-21swapper/321:10:123
54899144,7cyclictest33-21ksoftirqd/221:00:002
54899143,7cyclictest33-21ksoftirqd/221:20:212
54899143,7cyclictest33-21ksoftirqd/221:20:212
548991412,1cyclictest9664-21ssh21:59:492
548991412,1cyclictest29492-21ssh21:35:272
54899140,8cyclictest33-21ksoftirqd/200:20:002
547991410,3cyclictest11346-21head21:10:231
546991412,1cyclictest24633-21processes21:50:200
55399139,3cyclictest24139-21rm00:16:077
553991311,1cyclictest3328-21ssh21:55:357
553991311,1cyclictest27501-21uname20:45:207
553991311,1cyclictest10510-21ssh23:13:557
553991311,1cyclictest0-21swapper/723:46:237
553991310,2cyclictest6945-21tr21:25:137
552991311,1cyclictest134602sleep621:11:476
552991311,1cyclictest0-21swapper/621:35:566
55099139,2cyclictest7643-21grep19:20:104
550991311,1cyclictest49-21ksoftirqd/421:29:164
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional