You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-11-09 - 10:22
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the highest latencies:
System rackbslot7.osadl.org (updated Mon Nov 09, 2026 00:44:31)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
2090121427,99sleep020958-21tune2fs19:04:520
22153991283,81cyclictest0-21swapper/021:25:060
221539911722,73cyclictest0-21swapper/021:12:160
22165991163,86cyclictest26420-21apt-get22:49:392
221539911233,59cyclictest0-21swapper/021:34:360
22158991114,58cyclictest24523-21ssh23:39:361
221539911129,58cyclictest0-21swapper/023:09:260
221539911110,63cyclictest0-21swapper/021:14:340
221539911110,63cyclictest0-21swapper/021:14:340
221539910931,66cyclictest0-21swapper/021:49:480
22153991074,84cyclictest23859-21processes22:44:580
22153991074,84cyclictest23859-21processes22:44:580
221539910640,57cyclictest22149-21mailstats23:34:570
221539910640,57cyclictest22149-21mailstats23:34:570
22153991042,60cyclictest23049-21taskset00:29:400
22153991023,85cyclictest12276-21apt-get23:19:370
22153991023,59cyclictest19019-21sh22:37:270
221539910230,64cyclictest0-21swapper/000:14:520
221539910143,50cyclictest357-21runrttasks19:14:270
22153991013,62cyclictest21457-21seq20:44:370
22153991004,81cyclictest0-21swapper/022:24:390
22153991004,81cyclictest0-21swapper/022:24:390
22153991002,89cyclictest374-21snmpd00:10:310
22153991002,89cyclictest374-21snmpd00:10:310
221539910026,64cyclictest0-21swapper/000:19:590
22153991002,55cyclictest0-21swapper/021:44:140
22153999923,68cyclictest0-21swapper/000:27:550
22153999923,68cyclictest0-21swapper/000:27:550
2215399982,63cyclictest28009-21ssh22:51:200
2215399982,59cyclictest20698-21sh23:33:260
2215399973,83cyclictest28250-21rm00:37:580
22153999734,54cyclictest0-21swapper/019:19:550
2215399963,85cyclictest7539-21apt-get00:05:040
2215399963,82cyclictest0-21swapper/021:54:370
2215399963,82cyclictest0-21swapper/021:54:370
22153999635,53cyclictest0-21swapper/023:55:010
2215399962,60cyclictest25768-21seq23:40:260
2216599953,68cyclictest7610-21ssh00:04:452
2215399953,86cyclictest0-21swapper/019:14:420
22153999533,56cyclictest0-21swapper/022:59:400
22153999532,52cyclictest0-21swapper/022:20:010
2215399952,60cyclictest12319-21seq21:33:510
2215399952,60cyclictest12319-21seq21:33:510
2215399944,77cyclictest0-21swapper/020:14:410
2215399943,55cyclictest4659-21sh21:20:120
2215399943,55cyclictest4659-21sh21:20:120
22153999434,49cyclictest0-21swapper/020:30:060
2215399942,80cyclictest0-21swapper/020:54:350
2215399942,80cyclictest0-21swapper/020:54:350
2215399942,69cyclictest0-21swapper/022:57:090
2215399942,55cyclictest0-21swapper/022:14:350
208362949,59sleep120838-21diskstats19:04:491
22158999360,12cyclictest181rcu_preempt20:14:411
2215399932,55cyclictest15118-21sh22:30:070
22153999315,49cyclictest19502uname19:44:490
22165999222,19cyclictest18775-21latency_hist21:44:262
22158999259,12cyclictest181rcu_preempt22:19:581
2215399923,80cyclictest29266-21diskmemload00:04:250
2215399923,80cyclictest29266-21diskmemload00:04:250
2215399923,76cyclictest0-21swapper/020:04:370
2215399923,75cyclictest23065-21apt-get20:49:370
2215399913,62cyclictest19312-21apt-get20:39:240
2215399913,60cyclictest1177-21ssh22:08:410
2215399912,59cyclictest7923-21seq23:11:500
2215399903,74cyclictest0-21swapper/019:29:360
2215399903,74cyclictest0-21swapper/019:29:360
2215399902,77cyclictest19842-21apt-get20:39:390
22165998965,18cyclictest19624-21apt-key20:39:282
22158998964,15cyclictest26381-21fschecks_time00:34:461
2215899893,42cyclictest29266-21diskmemload00:04:411
2215399893,53cyclictest0-21swapper/023:29:250
22153998929,54cyclictest0-21swapper/022:14:240
22153998929,54cyclictest0-21swapper/022:14:240
2215399892,58cyclictest30192-21seq22:02:370
22165998859,23cyclictest3244-21latency_hist21:19:262
22165998859,23cyclictest3244-21latency_hist21:19:262
2216599883,48cyclictest30042-21wc19:30:002
2216599883,48cyclictest30042-21wc19:30:002
22153998821,59cyclictest0-21swapper/021:04:500
22158998734,15cyclictest181rcu_preempt21:04:571
22158998713,65cyclictest11162-21grep00:10:321
22158998713,65cyclictest11162-21grep00:10:321
2215399873,58cyclictest11087-21ssh23:17:080
2215399873,58cyclictest11087-21ssh23:17:080
22153998729,47cyclictest0-21swapper/020:19:370
22165998662,18cyclictest24747-21fschecks_count23:39:452
22165998657,20cyclictest4826-21cpu19:54:402
2215399863,76cyclictest10562-21grep20:10:050
2215399863,75cyclictest27981-21cut23:44:500
2215399863,71cyclictest0-21swapper/019:49:350
22153998622,54cyclictest0-21swapper/023:50:060
2215399852,79cyclictest0-21swapper/021:44:350
22153998511,44cyclictest0-21swapper/019:25:380
22153998511,44cyclictest0-21swapper/019:25:380
22165998462,16cyclictest611-21cron20:59:242
22165998462,16cyclictest611-21cron20:59:242
22158998462,14cyclictest19646-21latency_hist20:39:271
22158998457,12cyclictest181rcu_preempt23:29:371
22158998450,12cyclictest4878-21kworker/u19:0-flush-0:3123:10:311
2215399843,71cyclictest31073-21grep19:34:470
2215399843,71cyclictest31073-21grep19:34:470
2215399843,68cyclictest0-21swapper/020:59:370
2148828410,52sleep221573-21/usr/sbin/munin19:05:112
22165998361,16cyclictest22140-21cyclictest23:59:432
22165998361,16cyclictest22140-21cyclictest23:59:432
2216599833,43cyclictest25715-21latency_hist19:19:272
22158998358,18cyclictest4140-21latency_hist23:59:271
2215399833,70cyclictest14763-21apt-get20:24:370
2215399832,74cyclictest20091-21ssh22:39:330
22158998266,9cyclictest0-21swapper/121:10:291
22165998158,17cyclictest29266-21diskmemload21:25:292
22158998125,12cyclictest0-21swapper/122:29:401
2215399813,70cyclictest4796-21/usr/sbin/munin19:54:520
22165998028,38cyclictest30187-21cpu21:10:342
22158998063,11cyclictest278-21dbus-daemon22:49:241
22158998063,11cyclictest278-21dbus-daemon22:49:241
22153998024,50cyclictest0-21swapper/019:59:510
2217099797,52cyclictest0-21swapper/300:10:323
2217099797,52cyclictest0-21swapper/300:10:323
22165997960,13cyclictest23742-21kworker/u17:0-nfsiod23:39:172
22165997960,13cyclictest23742-21kworker/u17:0-nfsiod23:39:172
2216599792,44cyclictest4129-21latency_hist23:59:272
22165997922,19cyclictest3358-21fschecks_count23:04:462
22158997960,12cyclictest0-21swapper/123:09:251
22165997855,15cyclictest22140-21cyclictest22:37:332
22158997839,22cyclictest357-21runrttasks00:19:301
22165997760,11cyclictest6211-21munin-plugin-st21:24:262
22165997760,11cyclictest6211-21munin-plugin-st21:24:262
2216599775,51cyclictest7646-21kworker/u17:2+ext4-rsv-conversion00:10:212
2216599775,51cyclictest7646-21kworker/u17:2+ext4-rsv-conversion00:10:212
2215899773,38cyclictest11000-21modprobe20:14:241
2215399779,60cyclictest0-21swapper/019:44:240
22165997619,17cyclictest16204-21timerandwakeup23:25:002
22165997617,16cyclictest7636-21latency_hist22:19:252
22158997658,12cyclictest29266-21diskmemload21:16:081
22158997658,12cyclictest29266-21diskmemload21:16:081
22158997651,8cyclictest31-21ksoftirqd/123:24:321
22165997553,15cyclictest203-21systemd-journal22:41:282
22165997523,8cyclictest0-21swapper/221:09:242
22165997515,13cyclictest7867-21latency_hist20:04:262
22158997556,14cyclictest58-21kcompactd000:14:461
22158997554,15cyclictest29266-21diskmemload22:09:261
2215899754,50cyclictest30212-21ssh22:55:261
2215899753,50cyclictest4098-21ntp_states21:19:541
2215899753,50cyclictest4098-21ntp_states21:19:541
2215899752,51cyclictest6769-21apt-get21:24:421
22165997452,15cyclictest17920-21latency_hist20:34:272
22165997451,15cyclictest3829-21runrttasks19:49:562
22158997453,15cyclictest29266-21diskmemload21:49:481
22158997442,24cyclictest7179-21grep20:00:041
22165997350,17cyclictest10751-21timerwakeupswit21:30:012
22165997350,17cyclictest10751-21timerwakeupswit21:30:012
22165997320,12cyclictest22573-21ntpq21:49:522
22165997317,14cyclictest610-21awk22:59:512
22165997317,13cyclictest17714-21grep00:19:592
2215899737,50cyclictest13148-21apt-get20:19:391
22158997343,16cyclictest0-21swapper/100:04:271
22158997343,16cyclictest0-21swapper/100:04:271
22165997253,13cyclictest23406-21fschecks_count22:44:472
22165997253,13cyclictest23406-21fschecks_count22:44:472
22165997252,12cyclictest28136-21ntp_offset19:24:532
22165997252,12cyclictest28136-21ntp_offset19:24:532
22165997251,17cyclictest22140-21cyclictest23:16:162
22165997251,17cyclictest22140-21cyclictest23:16:162
22165997218,12cyclictest15740-21cat21:39:262
22158997244,18cyclictest0-21swapper/123:20:091
2215899723,31cyclictest3135-21ssh22:10:431
2215899723,31cyclictest3135-21ssh22:10:431
2215899722,62cyclictest8515-21kworker/u17:1+ext4-rsv-conversion22:49:391
2215899722,42cyclictest31-21ksoftirqd/123:35:191
2215899722,42cyclictest31-21ksoftirqd/123:35:191
22165997156,11cyclictest22140-21cyclictest22:21:182
22165997123,7cyclictest0-21swapper/223:54:262
2216599712,27cyclictest0-21swapper/200:15:562
22158997155,9cyclictest58-21kcompactd019:10:241
22165997056,10cyclictest26733-21kworker/u17:3-rpciod00:35:002
2216599704,42cyclictest18654-21grep23:29:462
22158997054,12cyclictest58-21kcompactd022:39:511
22158997051,14cyclictest9539-21kworker/u17:4-rpciod21:44:451
22158997051,13cyclictest297-21rs:main1
22158997051,13cyclictest297-21rs:main1
2215899704,45cyclictest2504-21tail19:45:011
2215899704,36cyclictest10950-21apt-get22:24:371
2215899704,36cyclictest10950-21apt-get22:24:371
22158997032,9cyclictest181rcu_preempt20:34:261
22158997019,13cyclictest181rcu_preempt23:54:231
22165996944,17cyclictest23858-21latency_hist19:14:272
2216599692,25cyclictest22406-21unixbench_singl20:44:592
2215899699,8cyclictest181rcu_preempt19:39:591
22158996953,9cyclictest22140-21cyclictest19:56:271
22158996949,14cyclictest23966-21unixbench_multi20:50:011
22158996944,13cyclictest0-21swapper/100:30:001
22165996850,11cyclictest22140-21cyclictest19:44:262
22165996845,17cyclictest28976-21sh22:00:102
22165996842,15cyclictest0-21swapper/220:24:262
22165996821,9cyclictest0-21swapper/222:26:262
22165996821,9cyclictest0-21swapper/222:26:262
22165996818,10cyclictest30010-21basename22:55:212
22165996815,13cyclictest31485-21fschecks_time22:04:462
2215899684,36cyclictest357-21runrttasks23:47:151
22158996834,10cyclictest181rcu_preempt19:34:471
22158996834,10cyclictest181rcu_preempt19:34:471
22165996743,16cyclictest203-21systemd-journal22:33:352
22165996743,15cyclictest13295-21unixbench_multi23:20:012
2216599673,43cyclictest1589-21/usr/sbin/munin19:44:582
2216599673,41cyclictest27826-21latency_hist21:04:262
2216599673,28cyclictest29266-21diskmemload00:24:552
2216599673,28cyclictest29266-21diskmemload00:24:552
22165996719,9cyclictest18924-21/usr/sbin/munin21:44:452
22158996741,19cyclictest3468-21fschecks_time19:49:461
22158996733,11cyclictest181rcu_preempt22:15:001
22158996722,9cyclictest181rcu_preempt21:39:231
22165996641,19cyclictest11536-21fschecks_time20:14:482
2216599662,43cyclictest21346-21latency_hist20:44:272
22158996645,16cyclictest22140-21cyclictest20:49:271
22158996636,9cyclictest181rcu_preempt19:14:411
2215899663,31cyclictest14772-21cpu20:24:421
2215899662,31cyclictest30188-21/usr/sbin/munin19:30:011
2215899662,31cyclictest30188-21/usr/sbin/munin19:30:011
2216599653,47cyclictest23971-21unixbench_multi20:50:012
22165996521,30cyclictest31045-21cut19:34:472
22165996521,30cyclictest31045-21cut19:34:472
22165996514,11cyclictest0-21swapper/223:09:392
22158996550,8cyclictest0-21swapper/121:55:061
22158996550,8cyclictest0-21swapper/121:55:061
22158996540,19cyclictest12115-21latency_hist23:19:271
22158996540,19cyclictest12115-21latency_hist23:19:271
22158996525,28cyclictest21635-21seq00:26:341
22158996525,28cyclictest21635-21seq00:26:341
22165996447,10cyclictest0-21swapper/221:54:492
22165996447,10cyclictest0-21swapper/221:54:492
2216599644,45cyclictest23151-21cstates00:29:432
22165996421,32cyclictest28612-21grep23:45:022
2215899645,30cyclictest8453-21ls20:04:501
22158996444,13cyclictest32500-21acpi22:59:341
2215899644,40cyclictest28196-21uname19:24:571
2215899644,40cyclictest28196-21uname19:24:571
22158996435,9cyclictest181rcu_preempt21:39:461
2217099635,43cyclictest5951-21taskset23:09:253
22170996314,31cyclictest0-21swapper/300:04:413
2216599632,23cyclictest39-21ksoftirqd/220:10:472
2215899637,50cyclictest17613-21kworker/u17:2+ext4-rsv-conversion20:40:191
2215899635,26cyclictest0-21swapper/120:54:391
2215899635,26cyclictest0-21swapper/120:54:391
2215899634,40cyclictest25986-21/usr/sbin/munin19:19:581
22158996342,11cyclictest0-21swapper/122:39:261
22158996336,9cyclictest181rcu_preempt22:00:031
22165996220,7cyclictest0-21swapper/222:09:342
22165996220,7cyclictest0-21swapper/222:09:342
2216599621,30cyclictest8238-21cut20:04:462
2217099618,42cyclictest26475-21chrt22:49:443
2216599613,42cyclictest26706-21switchtime19:19:562
2215899603,40cyclictest26396-21cstates20:59:421
211332608,34sleep30-21swapper/319:04:593
2217099599,33cyclictest0-21swapper/321:10:293
2217099592,47cyclictest18375-21chrt23:29:393
2216599594,39cyclictest15240-21/usr/sbin/munin20:24:532
2217099564,43cyclictest9435-21taskset23:14:443
2217099564,43cyclictest9435-21taskset23:14:443
2217099554,38cyclictest19239-21chrt21:44:453
2217099545,34cyclictest0-21swapper/321:24:393
2217099543,38cyclictest6360-21taskset21:24:263
2217099543,38cyclictest6360-21taskset21:24:263
2217099543,38cyclictest3126-21taskset21:19:233
2217099543,38cyclictest3126-21taskset21:19:233
2217099543,35cyclictest21655-21chrt20:44:443
2217099543,30cyclictest0-21swapper/320:19:483
2217099542,36cyclictest25881-21chrt19:19:273
2217099534,35cyclictest28103-21taskset00:37:353
2217099533,37cyclictest16364-21taskset23:25:023
2217099533,35cyclictest13117-21chrt21:34:473
2217099523,39cyclictest4456-21taskset23:59:423
2217099523,39cyclictest4456-21taskset23:59:423
2217099523,34cyclictest12713-21chrt21:34:273
2217099523,34cyclictest12713-21chrt21:34:273
2217099522,38cyclictest17634-21chrt21:41:413
2217099522,38cyclictest1401-21chrt19:44:263
2217099522,37cyclictest5157-21chrt22:14:483
2217099514,33cyclictest28697-21chrt23:45:073
2217099513,39cyclictest12237-21chrt22:25:333
2217099513,39cyclictest12237-21chrt22:25:333
2217099513,36cyclictest17909-21chrt20:34:273
2217099513,31cyclictest13823-21chrt00:14:333
2217099512,37cyclictest22000-21chrt21:49:353
2217099512,36cyclictest8903-21chrt23:14:243
2217099503,36cyclictest539-21chrt22:59:493
2217099503,36cyclictest23237-21chrt20:49:463
2217099503,36cyclictest20726-21taskset20:40:473
2217099503,35cyclictest9131-21chrt22:20:233
2217099503,33cyclictest25080-21chrt22:47:173
2217099503,33cyclictest25080-21chrt22:47:173
2217099502,37cyclictest17457-21chrt00:19:523
2217099502,36cyclictest12660-21taskset20:19:243
2217099493,37cyclictest9703-21chrt20:09:413
2217099493,35cyclictest21557-21taskset23:34:423
2217099493,35cyclictest21557-21taskset23:34:423
2217099493,35cyclictest1785-21taskset19:44:463
2217099493,35cyclictest17288-21chrt22:34:453
2217099493,34cyclictest4637-21chrt19:54:263
2217099493,33cyclictest14265-21chrt22:29:473
2217099493,31cyclictest28951-21chrt19:29:233
2217099493,31cyclictest28951-21chrt19:29:233
2217099492,36cyclictest3350-21chrt22:11:193
2217099492,36cyclictest3350-21chrt22:11:193
2217099492,34cyclictest24321-21chrt00:30:343
2217099492,33cyclictest26637-21taskset21:56:203
2217099492,33cyclictest26637-21taskset21:56:203
2217099483,36cyclictest7872-21chrt20:04:263
2217099483,36cyclictest12791-21chrt23:19:513
2217099482,35cyclictest30731-21chrt22:55:363
2217099482,35cyclictest26695-21taskset20:59:503
2217099473,34cyclictest3789-21chrt23:59:053
2217099473,32cyclictest25269-21chrt23:39:573
2217099473,29cyclictest30609-21chrt19:34:253
2217099473,29cyclictest30609-21chrt19:34:253
2217099463,34cyclictest31166-21chrt23:49:533
2217099463,34cyclictest26683-21chrt19:19:563
2217099463,32cyclictest8180-21chrt20:04:433
2217099463,32cyclictest5091-21chrt19:54:463
2217099463,31cyclictest32182-21chrt19:39:233
2217099463,31cyclictest32182-21chrt19:39:233
2217099463,31cyclictest32136-21taskset22:04:593
2217099463,29cyclictest20296-21chrt22:39:433
2217099463,27cyclictest31030-21chrt22:04:263
2217099462,35cyclictest21951-21chrt00:27:263
2217099462,35cyclictest21951-21chrt00:27:263
2217099443,28cyclictest29398-21chrt21:09:263
2217099443,26cyclictest15610-21chrt20:25:083
2217099443,24cyclictest23702-21chrt19:14:253
2217099423,27cyclictest25188-21chrt20:54:523
2217099423,27cyclictest25188-21chrt20:54:523
2217099403,27cyclictest19408-21chrt20:39:253
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional