You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-04-02 - 00:07
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the highest latencies:
System rackbslot7.osadl.org (updated Wed Apr 01, 2026 12:44:30)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
21161211421,50sleep10-21swapper/106:59:171
21161211421,50sleep10-21swapper/106:59:171
22805991093,68cyclictest2113-21apt-get10:04:211
22805999242,13cyclictest181rcu_preempt10:29:411
22789999165,18cyclictest14441-21kworker/u19:2-rpciod12:29:380
22789999117,37cyclictest15-21ksoftirqd/009:35:130
22789999117,37cyclictest15-21ksoftirqd/009:35:130
22789999117,37cyclictest15-21ksoftirqd/009:35:130
22816999037,14cyclictest0-21swapper/209:16:212
2280599876,49cyclictest29554-21apt-get10:49:291
22789998637,17cyclictest181rcu_preempt10:58:470
22789998637,17cyclictest181rcu_preempt10:58:470
22789998625,22cyclictest15-21ksoftirqd/010:33:320
2278999852,38cyclictest15-21ksoftirqd/010:20:490
22816998464,11cyclictest0-21swapper/209:49:062
22816998443,9cyclictest181rcu_preempt12:07:272
2281699842,59cyclictest16352-21apt-get09:34:222
2281699842,59cyclictest16352-21apt-get09:34:222
2281699842,59cyclictest16352-21apt-get09:34:222
22805998457,11cyclictest181rcu_preempt07:19:261
22805998436,12cyclictest181rcu_preempt08:44:361
22805998435,20cyclictest594-21latency_hist07:34:071
2278999847,41cyclictest15-21ksoftirqd/007:33:480
2278999844,41cyclictest15-21ksoftirqd/010:08:500
22816998361,14cyclictest0-21swapper/208:09:062
22816998350,8cyclictest181rcu_preempt08:44:222
22805998342,11cyclictest181rcu_preempt12:18:321
2278999832,29cyclictest15-21ksoftirqd/008:49:040
22816998258,15cyclictest18603-21apt-key12:19:062
22816998242,18cyclictest22763-21cyclictest12:30:022
22816998238,9cyclictest0-21swapper/208:59:252
22816998238,9cyclictest0-21swapper/208:59:252
2281699823,57cyclictest13812-21apt-get10:24:182
22805998256,11cyclictest181rcu_preempt10:48:041
22805998256,11cyclictest181rcu_preempt10:48:041
22805998238,12cyclictest181rcu_preempt11:29:261
22805998229,25cyclictest0-21swapper/112:04:251
22805998226,33cyclictest0-21swapper/110:35:471
2278999824,49cyclictest15-21ksoftirqd/011:55:030
219792827,50sleep222062-21unixbench_multi06:59:512
219792827,50sleep222062-21unixbench_multi06:59:512
22816998164,11cyclictest26486-21ssh10:44:212
22816998164,11cyclictest26486-21ssh10:44:212
22816998161,10cyclictest0-21swapper/207:44:072
22816998147,8cyclictest181rcu_preempt11:39:452
22805998154,19cyclictest25871-21ssh09:49:321
22805998130,15cyclictest181rcu_preempt07:59:321
2278999817,42cyclictest15-21ksoftirqd/011:14:150
22789998116,37cyclictest15-21ksoftirqd/012:19:010
221922816,59sleep00-21swapper/007:00:140
221922816,59sleep00-21swapper/007:00:140
22816998040,13cyclictest10184-21vmstat11:09:422
22805998055,18cyclictest352-21runrttasks11:59:361
22805998055,18cyclictest352-21runrttasks11:59:361
22805998050,8cyclictest181rcu_preempt08:04:251
22805998048,7cyclictest181rcu_preempt09:44:331
2280599803,54cyclictest14344-21apt-get10:24:181
2280599803,45cyclictest19030-21apt-get12:19:271
2278999806,41cyclictest15-21ksoftirqd/011:11:560
22789998013,38cyclictest15-21ksoftirqd/010:52:060
22816997963,9cyclictest0-21swapper/211:14:322
22816997960,9cyclictest0-21swapper/208:24:062
22816997960,9cyclictest0-21swapper/208:24:062
22816997944,17cyclictest29014-21apt-get10:49:202
22816997925,25cyclictest22127-21fschecks_count08:39:252
22805997941,8cyclictest181rcu_preempt11:54:191
22805997940,12cyclictest181rcu_preempt11:14:261
22789997941,11cyclictest58-21kcompactd008:04:260
22816997860,8cyclictest0-21swapper/208:54:082
22816997845,11cyclictest30243-21diskmemload09:56:302
2281699783,56cyclictest18479-21apt-get12:19:182
22805997847,8cyclictest9554-21ssh11:09:291
22805997833,15cyclictest181rcu_preempt08:29:071
22789997861,13cyclictest20069-21basename08:34:040
2278999783,45cyclictest15-21ksoftirqd/008:02:520
2278999783,42cyclictest15-21ksoftirqd/009:44:050
2278999782,37cyclictest15-21ksoftirqd/009:06:360
22789997811,34cyclictest15-21ksoftirqd/011:00:430
22816997756,15cyclictest11338-21entropy10:19:272
22816997754,15cyclictest5287-21sh10:09:222
22816997754,15cyclictest5287-21sh10:09:222
22816997753,11cyclictest181rcu_preempt10:34:482
22816997737,15cyclictest9946-21kworker/u18:0-flush-0:3209:21:592
22805997756,15cyclictest22763-21cyclictest10:58:131
22805997756,15cyclictest22763-21cyclictest10:58:131
22805997753,9cyclictest181rcu_preempt11:44:211
22805997734,31cyclictest13825-21ssh10:24:041
22789997752,10cyclictest15541-21ssh10:24:560
2278999774,41cyclictest15-21ksoftirqd/010:49:060
2278999774,41cyclictest15-21ksoftirqd/010:49:060
2278999773,30cyclictest15-21ksoftirqd/012:20:240
22816997642,11cyclictest374-21sshd11:30:182
22816997638,11cyclictest58-21kcompactd010:14:402
22805997644,7cyclictest181rcu_preempt12:24:401
22805997644,11cyclictest181rcu_preempt10:18:101
22805997640,8cyclictest181rcu_preempt09:33:391
22789997656,15cyclictest5394-21fschecks_time10:09:250
22789997656,15cyclictest5394-21fschecks_time10:09:250
2278999764,41cyclictest15-21ksoftirqd/011:20:230
2278999763,36cyclictest15-21ksoftirqd/007:09:070
22816997560,8cyclictest0-21swapper/207:34:282
22816997560,7cyclictest0-21swapper/208:55:022
22816997556,11cyclictest29130-21kworker/u17:1-nfsiod11:49:312
22816997556,11cyclictest29130-21kworker/u17:1-nfsiod11:49:312
22816997548,8cyclictest181rcu_preempt11:57:242
22816997545,9cyclictest181rcu_preempt12:09:152
22816997544,10cyclictest27245-21ntpq07:14:332
22816997540,16cyclictest19722-21fw_packets09:39:362
22816997539,11cyclictest0-21swapper/208:11:482
22816997539,11cyclictest0-21swapper/208:11:482
22805997545,22cyclictest29067-21fschecks_count08:59:241
22805997545,22cyclictest29067-21fschecks_count08:59:241
22805997543,7cyclictest181rcu_preempt09:59:071
22805997542,11cyclictest373-21lldpd09:09:291
2280599752,54cyclictest16373-21ssh09:34:181
2280599752,54cyclictest16373-21ssh09:34:181
2280599752,54cyclictest16373-21ssh09:34:181
2278999758,39cyclictest15-21ksoftirqd/012:04:180
2278999755,38cyclictest15-21ksoftirqd/009:44:210
22789997551,12cyclictest0-21swapper/010:19:060
22789997538,23cyclictest181rcu_preempt08:49:550
2278999753,29cyclictest15-21ksoftirqd/008:09:360
2278999753,29cyclictest15-21ksoftirqd/008:09:360
22789997526,23cyclictest15-21ksoftirqd/008:25:330
2278999752,39cyclictest15-21ksoftirqd/011:59:080
2278999752,39cyclictest15-21ksoftirqd/011:59:080
22789997510,39cyclictest15-21ksoftirqd/009:25:200
22816997455,12cyclictest27169-21latency_hist11:39:072
22816997455,12cyclictest27169-21latency_hist11:39:072
22816997453,15cyclictest544-21cron12:04:032
22816997453,15cyclictest544-21cron12:04:032
22816997443,10cyclictest2692-21ssh10:58:492
22816997443,10cyclictest2692-21ssh10:58:492
22816997438,10cyclictest58-21kcompactd011:27:482
22816997438,10cyclictest58-21kcompactd011:27:482
2281699742,53cyclictest2113-21apt-get10:04:262
22805997439,10cyclictest181rcu_preempt07:14:061
22805997438,11cyclictest181rcu_preempt11:39:401
2280599742,23cyclictest31290-21munin-run07:29:041
22789997454,13cyclictest6829-21sh09:19:040
22789997439,9cyclictest58-21kcompactd010:02:150
2278999743,43cyclictest15-21ksoftirqd/011:50:140
2278999743,43cyclictest15-21ksoftirqd/011:50:140
2278999743,31cyclictest15-21ksoftirqd/009:29:340
22789997417,31cyclictest15-21ksoftirqd/011:31:060
22789997415,10cyclictest15-21ksoftirqd/008:34:170
2263627415,40sleep30-21swapper/307:04:083
2263627415,40sleep30-21swapper/307:04:083
22816997349,8cyclictest181rcu_preempt11:03:132
22816997339,8cyclictest181rcu_preempt12:24:382
22805997344,10cyclictest181rcu_preempt10:59:391
22805997342,11cyclictest181rcu_preempt11:05:571
22805997337,7cyclictest181rcu_preempt08:39:061
2280599733,50cyclictest17765-21apt-get11:24:181
2280599733,50cyclictest17765-21apt-get11:24:181
2278999735,39cyclictest15-21ksoftirqd/009:19:340
2278999732,41cyclictest15-21ksoftirqd/012:14:030
22816997254,12cyclictest352-21runrttasks08:14:262
22816997253,13cyclictest30243-21diskmemload09:59:312
22816997249,17cyclictest15783-21idleruntime-cro09:34:032
22816997240,10cyclictest1303-21ssh09:09:242
22816997235,8cyclictest0-21swapper/207:19:382
22816997233,8cyclictest181rcu_preempt07:24:212
22805997257,11cyclictest22763-21cyclictest08:49:391
22805997247,8cyclictest181rcu_preempt11:39:071
22805997247,8cyclictest181rcu_preempt11:39:071
22805997240,10cyclictest181rcu_preempt09:24:401
22805997240,10cyclictest181rcu_preempt07:44:191
22805997240,10cyclictest181rcu_preempt07:44:191
22805997236,7cyclictest181rcu_preempt12:09:381
22805997233,7cyclictest181rcu_preempt07:34:301
22805997223,22cyclictest0-21swapper/110:39:091
22805997221,22cyclictest0-21swapper/111:49:391
22805997221,22cyclictest0-21swapper/111:49:391
2278999724,36cyclictest16620-21http08:24:040
2278999724,36cyclictest16620-21http08:24:040
2278999723,31cyclictest15-21ksoftirqd/008:14:350
2278999723,30cyclictest15-21ksoftirqd/012:25:550
2278999723,30cyclictest15-21ksoftirqd/009:54:240
2278999722,42cyclictest15-21ksoftirqd/011:39:170
22816997150,9cyclictest181rcu_preempt08:29:392
22816997143,8cyclictest181rcu_preempt07:44:302
22816997143,8cyclictest181rcu_preempt07:44:302
22816997143,20cyclictest21675-21latency_hist08:39:042
22816997140,10cyclictest6275-21diskstats11:04:222
22816997125,9cyclictest181rcu_preempt09:49:192
22805997139,10cyclictest181rcu_preempt09:59:211
22805997136,12cyclictest181rcu_preempt07:44:071
2278999719,36cyclictest15-21ksoftirqd/011:24:460
2278999719,36cyclictest15-21ksoftirqd/011:24:460
22789997143,21cyclictest10781-21kworker/u17:3+nfsiod11:34:460
22789997143,21cyclictest10781-21kworker/u17:3+nfsiod11:34:460
22816997049,15cyclictest784-21idleruntime-cro09:09:032
22816997044,8cyclictest181rcu_preempt07:05:242
22816997029,12cyclictest181rcu_preempt11:20:552
2280599706,27cyclictest301ktimers/112:34:031
22805997056,9cyclictest19676-21snmpd07:53:421
22805997043,10cyclictest181rcu_preempt10:11:181
22805997043,10cyclictest181rcu_preempt10:11:181
22805997020,18cyclictest0-21swapper/109:39:461
22789997038,11cyclictest181rcu_preempt07:49:230
2278999702,31cyclictest15-21ksoftirqd/009:50:420
22816996950,8cyclictest181rcu_preempt09:25:072
22816996925,8cyclictest181rcu_preempt07:29:202
22805996943,7cyclictest181rcu_preempt09:09:071
22805996940,8cyclictest181rcu_preempt07:05:241
22805996938,8cyclictest181rcu_preempt08:14:361
22805996938,7cyclictest181rcu_preempt09:19:131
22805996938,12cyclictest181rcu_preempt08:19:461
22805996938,12cyclictest181rcu_preempt08:19:461
22816996839,8cyclictest181rcu_preempt07:59:242
22816996837,9cyclictest381ktimers/207:54:062
22805996837,15cyclictest181rcu_preempt08:55:121
22805996836,7cyclictest181rcu_preempt08:40:581
2280599682,28cyclictest7175-21/usr/sbin/munin07:54:151
2278999684,30cyclictest1-21systemd09:04:040
2278999684,30cyclictest1-21systemd09:04:040
22789996842,20cyclictest4637-21kworker/u17:2+nfsiod11:07:380
2278999683,37cyclictest15-21ksoftirqd/007:14:260
22816996746,8cyclictest181rcu_preempt10:39:212
22805996737,24cyclictest1-21systemd11:24:061
2278999674,30cyclictest15-21ksoftirqd/010:44:070
2278999673,28cyclictest15-21ksoftirqd/007:34:190
22789996727,12cyclictest15-21ksoftirqd/007:54:070
2278999672,39cyclictest15-21ksoftirqd/007:47:170
2278999672,39cyclictest15-21ksoftirqd/007:47:170
22816996649,11cyclictest297-21systemd-logind07:14:052
22816996629,7cyclictest181rcu_preempt10:33:422
22789996650,10cyclictest25319-21fschecks_time07:09:290
22789996641,18cyclictest8961-21kworker/u17:3+nfsiod10:38:290
22789996614,21cyclictest15-21ksoftirqd/009:13:400
318382650,6sleep30-21swapper/309:05:103
22805996545,7cyclictest181rcu_preempt07:19:041
22805996522,20cyclictest0-21swapper/108:34:071
22789996551,10cyclictest22763-21cyclictest07:25:030
22789996550,9cyclictest623-21ssh11:49:060
22789996536,20cyclictest29673-21modprobe07:24:040
2278999652,32cyclictest15-21ksoftirqd/008:39:260
22816996448,11cyclictest24652-21munin-node11:46:142
22805996436,8cyclictest181rcu_preempt09:14:251
22805996436,12cyclictest181rcu_preempt08:09:411
22805996436,12cyclictest181rcu_preempt08:09:411
22820996349,9cyclictest451rcuc/311:19:423
22816996350,9cyclictest22763-21cyclictest08:24:082
22816996343,14cyclictest0-21swapper/207:54:262
22820996248,9cyclictest451rcuc/310:15:233
2278999624,30cyclictest26744-21apt-get08:54:150
2282099614,43cyclictest19034-21chrt12:19:153
22789996112,25cyclictest15-21ksoftirqd/007:39:330
2282099584,43cyclictest27603-21chrt11:39:273
22820995745,8cyclictest451rcuc/312:09:473
22820995745,8cyclictest451rcuc/308:14:233
22820995644,8cyclictest451rcuc/309:16:423
2282099564,42cyclictest23203-21taskset12:24:543
2282099564,40cyclictest4479-21taskset11:54:353
22820995641,10cyclictest451rcuc/307:44:063
22820995539,11cyclictest451rcuc/308:38:583
2282099553,43cyclictest18389-21taskset11:24:283
2282099553,43cyclictest18389-21taskset11:24:283
22820995438,11cyclictest451rcuc/309:12:083
2282099543,42cyclictest30238-21taskset09:56:533
2282099543,41cyclictest4873-21chrt10:09:063
2282099543,41cyclictest11188-21chrt12:05:293
2282099535,38cyclictest19558-21chrt09:39:273
2282099534,38cyclictest875-21chrt07:34:213
2282099534,38cyclictest29066-21chrt07:19:393
2282099534,37cyclictest7551-21taskset09:19:293
22820995339,9cyclictest451rcuc/307:49:453
22820995338,10cyclictest451rcuc/311:03:373
22820995337,9cyclictest0-21swapper/308:49:053
2282099533,41cyclictest26093-21taskset12:29:403
2282099533,39cyclictest27273-21taskset10:44:403
2282099533,39cyclictest27273-21taskset10:44:403
2282099533,38cyclictest27095-21chrt08:54:083
2282099532,37cyclictest9202-21chrt11:09:203
2282099524,37cyclictest17273-21taskset09:35:263
2282099524,37cyclictest17273-21taskset09:35:263
2282099524,37cyclictest17273-21taskset09:35:263
2282099524,37cyclictest11358-21taskset10:19:273
2282099524,36cyclictest29736-21chrt08:59:393
2282099524,36cyclictest29736-21chrt08:59:393
2282099524,36cyclictest14397-21chrt11:18:033
22820995239,8cyclictest451rcuc/307:05:143
22820995237,11cyclictest451rcuc/308:04:023
22820995236,9cyclictest451rcuc/311:38:013
22820995236,9cyclictest451rcuc/311:38:013
2282099523,40cyclictest22587-21taskset11:30:113
2282099523,37cyclictest18851-21chrt10:30:503
2282099523,37cyclictest16809-21chrt12:14:413
2282099522,37cyclictest26710-21chrt07:14:083
2282099515,35cyclictest5735-21taskset10:09:343
2282099515,35cyclictest5735-21taskset10:09:343
2282099514,36cyclictest32362-21taskset09:59:413
22820995135,11cyclictest451rcuc/309:26:103
22820995134,11cyclictest451rcuc/308:29:103
2282099513,38cyclictest7285-21chrt11:59:293
2282099513,38cyclictest7285-21chrt11:59:293
2282099513,36cyclictest15032-21chrt10:24:463
2282099512,36cyclictest30107-21taskset07:24:243
2282099504,36cyclictest26479-21taskset07:14:043
22820995035,10cyclictest451rcuc/307:31:103
2282099503,36cyclictest32676-21chrt10:54:203
2282099503,36cyclictest32676-21chrt10:54:203
2282099503,34cyclictest30311-21chrt11:44:173
2282099503,34cyclictest20682-21chrt10:34:273
2282099502,39cyclictest10700-21taskset08:04:263
22820994934,10cyclictest451rcuc/308:55:473
2282099493,31cyclictest23293-21chrt10:39:093
22820994836,8cyclictest451rcuc/310:52:273
22820994834,9cyclictest451rcuc/309:44:343
2282099483,37cyclictest13356-21chrt09:29:263
2282099483,34cyclictest25329-21taskset09:49:153
2282099482,31cyclictest5512-21taskset07:49:073
2282099474,31cyclictest16836-21chrt08:24:063
2282099474,31cyclictest16836-21chrt08:24:063
22820994633,8cyclictest451rcuc/308:26:023
2282099463,32cyclictest12882-21chrt08:09:413
2282099463,32cyclictest12882-21chrt08:09:413
2282099454,30cyclictest830-21chrt11:49:163
2282099454,30cyclictest830-21chrt11:49:163
2282099453,31cyclictest22362-21chrt08:39:303
22820994532,8cyclictest451rcuc/307:59:043
2282099435,28cyclictest8093-21chrt11:07:133
2282099423,30cyclictest4081-21taskset07:44:213
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional