You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-07-25 - 01:46
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the 792 highest latencies:
System rack0slot2.osadl.org (updated Sat Jul 25, 2026 00:43:33)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
3182580995553,2cyclictest3749485-21kworker/u16:3+flush-8:000:09:494
318213525343,7sleep50-21swapper/519:07:135
318211624534,8sleep40-21swapper/419:06:564
31820302438,30sleep70-21swapper/719:05:467
3182580993836,2cyclictest3883875-21kworker/u16:0+events_unbound00:35:384
3182580993836,2cyclictest3725440-21kworker/u16:0+events_unbound23:33:394
3182580993735,2cyclictest3428517-21kworker/u16:0+events_unbound21:12:354
3182580993735,2cyclictest3351462-21kworker/u16:2+events_unbound22:52:074
3182580993732,2cyclictest3517140-21kworker/u16:0+events_unbound22:36:354
36629222360,1chrt0-21swapper/422:47:304
3182580993634,2cyclictest3517140-21kworker/u16:0+events_unbound22:16:064
3182580993634,2cyclictest3441477-21kworker/u16:1+events_unbound21:28:364
3182580993634,2cyclictest3351462-21kworker/u16:2+events_unbound23:03:474
3182580993634,2cyclictest3215608-21kworker/u16:4+events_unbound19:29:184
3182580993634,2cyclictest3215608-21kworker/u16:4+events_unbound19:29:184
3182590993528,5cyclictest3322308-21latency_hist20:19:177
3182580993533,2cyclictest3859576-21kworker/u16:4+events_unbound00:19:194
3182580993533,2cyclictest3725440-21kworker/u16:0+flush-8:023:27:384
3182580993533,2cyclictest3600512-21kworker/u16:1+events_unbound22:23:064
3182580993533,2cyclictest3517140-21kworker/u16:0+events_unbound21:56:434
3182580993432,2cyclictest3810456-21kworker/u16:2+events_unbound23:52:384
3182580993432,2cyclictest3698368-21kworker/u16:1+events_unbound23:35:384
3182580993432,2cyclictest3517140-21kworker/u16:0+flush-8:022:09:514
3182580993432,2cyclictest3351462-21kworker/u16:2+events_unbound22:01:154
318214523423,8sleep60-21swapper/619:07:226
3182580993331,2cyclictest3810456-21kworker/u16:2+events_unbound00:27:354
3182580993331,2cyclictest3810456-21kworker/u16:2+events_unbound00:27:354
3182580993331,2cyclictest3749485-21kworker/u16:3+events_unbound23:58:384
3182580993331,2cyclictest3749485-21kworker/u16:3+events_unbound23:45:424
3182580993331,2cyclictest3749485-21kworker/u16:3+events_unbound23:45:424
3182580993331,2cyclictest3600512-21kworker/u16:1+flush-8:022:24:594
3182580993331,2cyclictest3541752-21kworker/u16:4+events_unbound23:06:474
3182580993331,2cyclictest3428517-21kworker/u16:0+flush-8:021:32:474
3182580993331,2cyclictest3428517-21kworker/u16:0+events_unbound21:21:544
3182580993331,2cyclictest3351462-21kworker/u16:2+events_unbound23:20:234
3182580993331,2cyclictest3351462-21kworker/u16:2+events_unbound22:09:064
3182580993330,2cyclictest3428517-21kworker/u16:0+flush-8:021:34:194
3182580993330,2cyclictest3399846-21kworker/u16:1+flush-8:020:59:174
318259099320,30cyclictest3399958-21latency_hist20:59:167
3182580993230,2cyclictest3810456-21kworker/u16:2+flush-8:000:19:104
3182580993230,2cyclictest3810456-21kworker/u16:2+flush-8:000:00:394
3182580993230,2cyclictest3810456-21kworker/u16:2+events_unbound00:31:144
3182580993230,2cyclictest3351462-21kworker/u16:2+flush-8:023:15:114
3182580993230,2cyclictest3351462-21kworker/u16:2+events_unbound21:47:124
3182580993129,2cyclictest3749485-21kworker/u16:3+events_unbound00:05:384
3182580993129,2cyclictest3517140-21kworker/u16:0+events_unbound21:53:024
3182585993027,2cyclictest3456337-21kworker/u16:3+flush-8:021:39:426
3182580993028,2cyclictest3351462-21kworker/u16:2+events_unbound23:11:514
3182580993028,2cyclictest3351462-21kworker/u16:2+events_unbound22:58:204
39203852290,1chrt3920386-21idleruntime-cro00:34:167
3182590992925,3cyclictest125-21kswapd022:08:427
3182580992927,2cyclictest3725440-21kworker/u16:0+events_unbound23:43:394
3182580992927,2cyclictest3541752-21kworker/u16:4+flush-8:022:29:554
3182580992927,2cyclictest3456337-21kworker/u16:3+events_unbound21:43:594
3182580992927,2cyclictest3428517-21kworker/u16:0+events_unbound21:16:184
3182585992826,2cyclictest3351462-21kworker/u16:2+flush-8:021:04:326
38830412270,1chrt3883042-21sh00:17:497
3182580992725,2cyclictest3517140-21kworker/u16:0+events_unbound22:40:104
3182580992725,2cyclictest3361090-21kworker/u16:4+events_unbound21:04:404
3182580992725,2cyclictest3109306-21kworker/u16:3+flush-8:019:14:394
3182580992623,2cyclictest3312276-21kworker/u16:0+events_unbound20:34:194
3182590992524,0cyclictest0-21swapper/723:22:487
3182590992524,0cyclictest0-21swapper/722:24:247
3182590992520,4cyclictest3712811-21latency_hist23:09:167
3182590992423,0cyclictest0-21swapper/723:42:307
3182590992423,0cyclictest0-21swapper/720:14:037
3182580992422,2cyclictest3312276-21kworker/u16:0+events_unbound20:16:434
3182580992422,2cyclictest3254102-21kworker/u16:1+events_unbound19:46:264
3182590992322,0cyclictest0-21swapper/723:32:527
3182590992322,0cyclictest0-21swapper/719:48:357
3182590992317,5cyclictest3456106-21latency_hist21:24:177
3182580992320,3cyclictest3293584-21kworker/u16:1+events_unbound20:05:394
3182590992221,0cyclictest0-21swapper/720:06:357
3182590992221,0cyclictest0-21swapper/720:02:197
3182590992221,0cyclictest0-21swapper/719:51:237
3182590992116,4cyclictest3480500-21latency_hist21:34:167
3182580992119,2cyclictest3312276-21kworker/u16:0+flush-8:020:55:354
3182580992119,2cyclictest3312276-21kworker/u16:0+events_unbound20:48:274
3182580992119,2cyclictest3264414-21kworker/u16:2+events_unbound19:49:264
3182580992119,2cyclictest3109306-21kworker/u16:3+events_unbound19:22:274
3182580992118,2cyclictest3301863-21kworker/u16:3+flush-8:020:19:274
3182590992019,0cyclictest0-21swapper/723:50:007
3182590992019,0cyclictest0-21swapper/722:20:447
3182590992019,0cyclictest0-21swapper/719:23:387
3182590992019,0cyclictest0-21swapper/700:22:367
3182590992018,1cyclictest3442066-21ssh21:16:047
3182590992017,2cyclictest3468440-21sed21:29:177
3182580992018,2cyclictest3312276-21kworker/u16:0+events_unbound20:12:274
3182580992018,2cyclictest3153718-21kworker/u16:0+events_unbound19:35:274
3182590991918,0cyclictest0-21swapper/722:43:337
3182590991918,0cyclictest0-21swapper/720:21:297
3182590991918,0cyclictest0-21swapper/719:33:427
3182590991918,0cyclictest0-21swapper/719:33:427
3182590991918,0cyclictest0-21swapper/700:04:257
3182580991916,2cyclictest3293584-21kworker/u16:1+events_unbound20:24:194
3182590991817,0cyclictest0-21swapper/720:44:427
3182590991815,2cyclictest3907050-21ssh00:27:127
3182590991815,2cyclictest3907050-21ssh00:27:127
3182590991812,5cyclictest3431599-21latency_hist21:14:177
318259099180,16cyclictest1302-21snmpd22:37:037
3182585991815,2cyclictest3749485-21kworker/u16:3+flush-8:000:04:386
3182590991716,0cyclictest0-21swapper/723:35:077
3182590991716,0cyclictest0-21swapper/721:34:517
3182590991716,0cyclictest0-21swapper/719:14:507
3182585991716,1cyclictest3517140-21kworker/u16:0+flush-8:022:14:456
3182590991615,0cyclictest0-21swapper/721:52:407
318259099160,14cyclictest0-21swapper/720:59:437
318258599160,15cyclictest3294334-21hddtemp_smartct20:04:306
3182580991614,2cyclictest3109306-21kworker/u16:3+flush-8:019:10:484
3182580991613,2cyclictest3293584-21kworker/u16:1+flush-8:020:29:224
3182590991514,0cyclictest0-21swapper/723:49:097
3182590991514,0cyclictest0-21swapper/723:49:097
3182590991514,0cyclictest0-21swapper/723:27:337
3182590991514,0cyclictest0-21swapper/720:43:047
3182590991514,0cyclictest0-21swapper/720:37:367
3182590991513,1cyclictest3724344-21sh23:13:037
3182590991513,1cyclictest0-21swapper/722:03:207
3182590991512,2cyclictest3847225-21idleruntime-cro00:04:167
3182590991512,2cyclictest3662383-21ssh22:46:317
318259099150,14cyclictest0-21swapper/720:49:427
3182585991511,3cyclictest3922782-21grep00:34:356
3182580991513,2cyclictest3254102-21kworker/u16:1+events_unbound19:42:274
3182580991512,2cyclictest3312276-21kworker/u16:0+events_unbound20:39:184
318259099149,4cyclictest1302-21snmpd19:13:567
3182590991413,0cyclictest0-21swapper/722:52:197
3182590991410,3cyclictest1302-21snmpd00:12:117
318259099140,13cyclictest1302-21snmpd20:27:437
318259099140,13cyclictest0-21swapper/719:39:387
318258599149,4cyclictest3518502-21cat21:49:326
318258599140,1cyclictest0-21swapper/622:12:516
318258599140,14cyclictest0-21swapper/622:46:266
318258599140,14cyclictest0-21swapper/619:29:306
318258599140,14cyclictest0-21swapper/619:29:306
3182583991413,1cyclictest0-21swapper/523:19:545
3182583991413,1cyclictest0-21swapper/520:04:415
3182583991412,2cyclictest0-21swapper/523:46:525
3182583991412,2cyclictest0-21swapper/523:46:525
318258399140,14cyclictest0-21swapper/523:34:535
318258399140,14cyclictest0-21swapper/522:43:295
3182580991412,2cyclictest3264414-21kworker/u16:2+flush-8:019:58:554
3182580991412,2cyclictest3153718-21kworker/u16:0+events_unbound19:26:084
318259099139,3cyclictest1302-21snmpd22:55:517
318259099139,3cyclictest1302-21snmpd00:35:037
318259099138,3cyclictest1302-21snmpd22:09:517
3182590991312,0cyclictest0-21swapper/720:29:537
3182590991312,0cyclictest0-21swapper/719:56:427
3182590991310,2cyclictest3834943-21munin-run23:59:167
3182585991312,1cyclictest0-21swapper/623:55:016
3182585991312,1cyclictest0-21swapper/623:28:126
3182585991312,1cyclictest0-21swapper/622:50:226
3182585991312,1cyclictest0-21swapper/622:25:566
3182585991312,1cyclictest0-21swapper/621:19:336
3182585991312,1cyclictest0-21swapper/600:32:046
3182585991312,1cyclictest0-21swapper/600:24:586
3182585991312,1cyclictest0-21swapper/600:24:586
3182585991312,1cyclictest0-21swapper/600:11:536
3182585991312,1cyclictest0-21swapper/600:01:286
3182585991311,2cyclictest3351462-21kworker/u16:2+flush-8:020:59:116
3182585991310,2cyclictest3428517-21kworker/u16:0+flush-8:021:29:406
318258599130,13cyclictest0-21swapper/623:45:056
318258599130,13cyclictest0-21swapper/623:45:056
318258599130,13cyclictest0-21swapper/623:21:456
318258599130,0cyclictest0-21swapper/621:26:486
3182583991312,1cyclictest0-21swapper/522:59:535
3182583991312,1cyclictest0-21swapper/521:46:535
3182583991312,1cyclictest0-21swapper/521:36:385
3182583991312,1cyclictest0-21swapper/500:32:355
3182583991312,1cyclictest0-21swapper/500:28:015
3182583991312,1cyclictest0-21swapper/500:28:015
3182583991312,1cyclictest0-21swapper/500:21:235
318258399130,13cyclictest0-21swapper/523:59:485
318258399130,13cyclictest0-21swapper/523:55:515
318258399130,13cyclictest0-21swapper/522:50:545
318258399130,13cyclictest0-21swapper/521:56:395
318258399130,13cyclictest0-21swapper/521:51:465
318258399130,13cyclictest0-21swapper/500:36:415
318258399130,12cyclictest0-21swapper/519:19:185
3182580991311,2cyclictest3153718-21kworker/u16:0+events_unbound20:00:554
318259099129,2cyclictest1302-21snmpd23:00:157
318259099128,3cyclictest1302-21snmpd22:18:277
318259099128,3cyclictest1302-21snmpd21:46:327
318259099128,3cyclictest1302-21snmpd21:06:257
318259099128,3cyclictest1302-21snmpd19:25:477
318258599127,4cyclictest3373987-21kthreadcore20:44:336
3182585991211,1cyclictest0-21swapper/623:31:416
3182585991211,1cyclictest0-21swapper/623:09:466
3182585991211,1cyclictest0-21swapper/622:20:066
3182585991211,1cyclictest0-21swapper/621:59:456
3182585991211,1cyclictest0-21swapper/621:18:366
3182585991211,1cyclictest0-21swapper/619:34:426
3182585991211,1cyclictest0-21swapper/600:17:526
3182585991210,2cyclictest86-21ksoftirqd/619:44:386
318258599120,1cyclictest0-21swapper/620:17:366
3182583991211,1cyclictest0-21swapper/523:43:525
3182583991211,1cyclictest0-21swapper/523:31:535
3182583991211,1cyclictest0-21swapper/522:31:115
3182583991211,1cyclictest0-21swapper/522:09:445
3182583991211,1cyclictest0-21swapper/521:42:005
3182583991211,1cyclictest0-21swapper/521:31:165
318258399120,1cyclictest0-21swapper/520:02:495
318258399120,12cyclictest0-21swapper/520:31:035
318258399120,12cyclictest0-21swapper/519:40:455
318258399120,0cyclictest0-21swapper/521:18:405
3182580991210,2cyclictest3361090-21kworker/u16:4+events_unbound20:51:114
318259099118,2cyclictest1302-21snmpd21:55:147
318259099118,2cyclictest1302-21snmpd21:43:417
318259099117,3cyclictest1302-21snmpd23:14:377
318259099117,3cyclictest1302-21snmpd22:29:217
3182590991111,0cyclictest0-21swapper/719:36:537
318258599117,3cyclictest3200559-21kthreadcore19:14:356
318258599116,4cyclictest3421394-21cut21:09:346
318258599115,5cyclictest3352537-21cat20:34:326
318258599112,3cyclictest3790167-21kthreadcore23:39:356
3182585991110,1cyclictest0-21swapper/623:51:336
3182585991110,1cyclictest0-21swapper/623:15:456
3182585991110,1cyclictest0-21swapper/622:06:326
3182585991110,1cyclictest0-21swapper/619:50:576
318258599110,10cyclictest3508438-21cut21:44:346
318258399119,2cyclictest3875964-21kthreadcore00:14:335
3182583991110,1cyclictest0-21swapper/523:52:515
3182583991110,1cyclictest0-21swapper/523:13:555
3182583991110,1cyclictest0-21swapper/523:05:525
3182583991110,1cyclictest0-21swapper/522:20:565
3182583991110,1cyclictest0-21swapper/522:15:355
3182583991110,1cyclictest0-21swapper/521:20:055
3182583991110,1cyclictest0-21swapper/520:53:165
3182583991110,1cyclictest0-21swapper/520:25:035
3182583991110,1cyclictest0-21swapper/520:20:295
3182583991110,1cyclictest0-21swapper/520:10:525
3182583991110,1cyclictest0-21swapper/519:48:385
3182583991110,1cyclictest0-21swapper/519:12:325
3182583991110,1cyclictest0-21swapper/500:05:195
318258399110,11cyclictest0-21swapper/521:03:125
318258599109,1cyclictest0-21swapper/622:56:506
318258599109,1cyclictest0-21swapper/621:58:496
318258599109,1cyclictest0-21swapper/621:35:006
318258599105,4cyclictest3284635-21cat19:59:316
318258599104,5cyclictest0-21swapper/622:59:456
318258599102,7cyclictest3885030-21fschecks_time00:19:326
318258599100,9cyclictest3623003-21kthreadcore22:29:376
318258599100,2cyclictest3402525-21cut20:59:366
318258599100,2cyclictest0-21swapper/620:19:356
318258399109,1cyclictest0-21swapper/523:25:545
318258399109,1cyclictest0-21swapper/523:16:545
318258399109,1cyclictest0-21swapper/522:26:185
318258399109,1cyclictest0-21swapper/519:24:315
318258399103,4cyclictest3321601-21ls20:14:455
318258399100,0cyclictest0-21swapper/519:51:475
31825859998,1cyclictest0-21swapper/619:13:546
31825859997,1cyclictest0-21swapper/619:24:426
31825859996,2cyclictest3244998-21/usr/sbin/munin19:39:296
31825859995,3cyclictest3704772-21kthreadcore23:04:356
31825859993,5cyclictest0-21swapper/623:34:336
31825859990,8cyclictest3640217-21expr22:39:296
31825859990,8cyclictest3364119-21cut20:39:336
31825859990,8cyclictest0-21swapper/620:24:336
31825859990,4cyclictest3628516-21ip_192.168.114.22:34:306
31825859990,3cyclictest3381316-21cstates20:49:296
31825839998,1cyclictest0-21swapper/522:56:535
31825839998,1cyclictest0-21swapper/522:35:365
31825839998,1cyclictest0-21swapper/522:09:165
31825839998,1cyclictest0-21swapper/521:10:565
31825839998,1cyclictest0-21swapper/520:38:565
31825839994,4cyclictest3204796-21ntpq19:14:415
31825839990,8cyclictest3658761-21cut22:44:375
31825859980,7cyclictest0-21swapper/619:54:336
31825839987,1cyclictest0-21swapper/521:25:555
31825839986,1cyclictest0-21swapper/520:39:285
31825839986,1cyclictest0-21swapper/500:09:385
31825839984,3cyclictest3244147-21unixbench-2d19:34:455
31825839984,3cyclictest3226348-21cat19:29:325
31825839984,3cyclictest3226348-21cat19:29:325
31825839983,4cyclictest3545315-21cut21:59:345
31825839983,4cyclictest3410583-21entropy21:04:305
31825859974,2cyclictest3342907-21sh20:29:326
31825859972,4cyclictest3304035-21sed20:09:316
31825859970,7cyclictest0-21swapper/619:19:306
31825839973,3cyclictest3391174-21forks20:54:315
31825839973,3cyclictest3371936-21if_err_p4p120:44:305
31825839973,3cyclictest3275510-21kthreadcore19:54:345
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional