You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-01-07 - 00:42
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the highest latencies:
System rackbslot7.osadl.org (updated Tue Jan 06, 2026 12:44:35)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
898220512,38sleep00-21swapper/007:06:010
1694991293,83cyclictest22809-21apt-get10:24:560
32707212810,86sleep132673-21apt-get07:05:131
1694991204,91cyclictest8079-21apt-get11:45:000
1694991204,91cyclictest8079-21apt-get11:45:000
170921110,16sleep0211rcuc/011:34:560
1694991103,68cyclictest14416-21ssh11:55:010
1694991103,68cyclictest14416-21ssh11:55:010
16949910725,57cyclictest352-21runrttasks11:17:380
16949910631,56cyclictest0-21swapper/007:35:140
16949910548,51cyclictest298-21in:imuxsock08:14:400
16949910548,51cyclictest298-21in:imuxsock08:14:400
16949910541,57cyclictest0-21swapper/011:50:080
16949910239,57cyclictest0-21swapper/012:05:180
2225321010,6sleep30-21swapper/312:07:153
1694999939,52cyclictest0-21swapper/011:09:440
1702999826,50cyclictest0-21swapper/111:16:291
169499983,81cyclictest5878-21/usr/sbin/munin09:00:050
170299974,68cyclictest23362-21apt-get10:24:591
169499974,76cyclictest8581-21sed10:00:170
1694999737,50cyclictest0-21swapper/007:30:020
1694999736,51cyclictest0-21swapper/012:24:420
211022960,4sleep10-21swapper/108:05:151
211022960,4sleep10-21swapper/108:05:151
169499965,82cyclictest16932-21apt-get10:14:560
1694999651,25cyclictest0-21swapper/011:24:440
1694999651,25cyclictest0-21swapper/011:24:440
1694999643,47cyclictest1082-21timerandwakeup10:40:170
169499962,54cyclictest8813-21seq09:09:210
1694999547,44cyclictest1688-21cyclictest09:49:490
1694999535,53cyclictest0-21swapper/009:20:200
1694999526,62cyclictest0-21swapper/011:59:570
171099946,13cyclictest0-21swapper/209:19:572
1694999434,55cyclictest0-21swapper/009:35:080
171099934,32cyclictest24527-21modprobe11:19:402
1694999335,50cyclictest0-21swapper/009:15:130
1694999312,52cyclictest11706-21rm10:58:260
1694999312,52cyclictest11706-21rm10:58:260
1710999241,44cyclictest10757-21/usr/sbin/munin10:05:042
171099923,32cyclictest20559-21fschecks_time08:05:022
171099923,32cyclictest20559-21fschecks_time08:05:022
169499924,74cyclictest3379-21apt-get12:29:540
1694999241,44cyclictest13945-21ssh10:09:580
1694999241,44cyclictest13945-21ssh10:09:580
1694999235,50cyclictest0-21swapper/008:24:430
1694999225,60cyclictest0-21swapper/011:29:400
169499922,55cyclictest25253-21taskset12:12:030
171099915,33cyclictest7670-21/usr/sbin/munin10:00:152
171099914,36cyclictest30152-21sed12:20:072
1710999142,42cyclictest0-21swapper/210:59:412
1710999142,42cyclictest0-21swapper/210:59:412
171099913,35cyclictest4105-21grep10:45:152
171099913,35cyclictest4105-21grep10:45:152
171099913,34cyclictest31869-21/usr/sbin/munin08:40:002
171099913,34cyclictest31869-21/usr/sbin/munin08:40:002
1702999149,35cyclictest21444-21latency_hist11:14:441
1702999149,35cyclictest21444-21latency_hist11:14:441
169499913,60cyclictest2581-21ssh12:28:260
169499912,56cyclictest13221-21sh10:08:530
171099905,33cyclictest26345-21/usr/sbin/munin10:30:272
171099904,34cyclictest30613-21tr08:35:062
171099904,34cyclictest30613-21tr08:35:062
171099903,36cyclictest14697-21cut11:55:092
171099903,36cyclictest14697-21cut11:55:092
171099903,35cyclictest2147-21fschecks_time07:10:042
170299903,62cyclictest8143-21ssh11:45:001
170299903,62cyclictest8143-21ssh11:45:001
1694999038,45cyclictest0-21swapper/010:50:170
169499902,80cyclictest3184-21grep08:50:110
169499902,80cyclictest3184-21grep08:50:110
171099894,35cyclictest23585-21cpuspeed12:09:582
171099894,34cyclictest21376-21latency_hist09:29:432
171099894,33cyclictest23339-21/usr/sbin/munin10:25:592
171099893,33cyclictest352-21runrttasks12:35:532
1710998922,23cyclictest10314-21sh09:10:202
1710998922,23cyclictest10314-21sh09:10:202
1702998941,40cyclictest0-21swapper/109:45:151
1702998925,54cyclictest10297-21sed10:55:181
1702998925,54cyclictest10297-21sed10:55:181
169499893,56cyclictest0-21swapper/011:39:550
169499892,80cyclictest24195-21rm09:34:200
169499892,54cyclictest31296-21seq08:36:000
169499892,54cyclictest31296-21seq08:36:000
1694998913,43cyclictest0-21swapper/011:00:080
171099885,34cyclictest352-21runrttasks11:36:292
171099885,31cyclictest6139-21ps07:20:142
171099884,37cyclictest16732-21latency_hist07:54:442
171099884,37cyclictest16732-21latency_hist07:54:442
171099884,35cyclictest1774-21fschecks_time09:50:022
171099884,32cyclictest352-21runrttasks07:39:112
171099884,31cyclictest2957-21basename08:50:052
171099884,31cyclictest2957-21basename08:50:052
171099883,37cyclictest14945-21grep10:10:192
171099883,37cyclictest14945-21grep10:10:192
171099883,37cyclictest14074-21latency_hist11:54:432
171099883,36cyclictest25754-21idleruntime08:20:322
171099883,36cyclictest21444-21latency_hist11:14:432
171099883,36cyclictest21444-21latency_hist11:14:432
171099883,33cyclictest23125-21latency_hist10:24:452
1702998872,11cyclictest1688-21cyclictest07:29:441
1694998831,49cyclictest0-21swapper/010:45:130
1694998831,49cyclictest0-21swapper/010:45:130
169499882,77cyclictest9814-21ssh09:10:110
169499882,77cyclictest9814-21ssh09:10:110
1694998827,55cyclictest0-21swapper/008:05:020
1694998827,55cyclictest0-21swapper/008:05:020
154828813,48sleep21571-21munin-run07:09:422
171099875,36cyclictest5855-21ssh09:55:442
171099875,36cyclictest5855-21ssh09:55:442
171099874,37cyclictest352-21runrttasks09:19:032
171099874,36cyclictest31011-21cstates09:44:582
171099873,35cyclictest352-21runrttasks10:53:572
171099873,33cyclictest3476-21munin-node11:04:492
171099873,31cyclictest352-21runrttasks08:59:492
171099872,37cyclictest2959-21awk10:44:412
1710998720,56cyclictest0-21swapper/209:39:442
1702998757,21cyclictest28377-21idleruntime-cro08:29:411
1702998757,21cyclictest28377-21idleruntime-cro08:29:411
170299873,74cyclictest13850-21apt-get10:09:531
170299873,74cyclictest13850-21apt-get10:09:531
169499874,72cyclictest18711-21apt-get07:59:550
169499874,72cyclictest18711-21apt-get07:59:550
171099864,32cyclictest24312-21timerandwakeup08:15:152
171099864,32cyclictest24312-21timerandwakeup08:15:152
171099863,40cyclictest20458-21/usr/sbin/munin12:04:572
171099863,35cyclictest1483-21cat11:34:432
171099863,34cyclictest5507-21wc11:40:152
169499864,54cyclictest16574-21apt-get07:54:550
169499863,78cyclictest0-21swapper/009:44:510
169499863,67cyclictest7169-21apt-get07:24:580
1694998636,44cyclictest21619-21ssh10:21:320
1694998635,46cyclictest2971-21kworker/u17:3+xprtiod11:30:420
1694998631,48cyclictest0-21swapper/009:25:190
1694998627,53cyclictest277-21dbus-daemon12:19:420
1694998627,53cyclictest277-21dbus-daemon12:19:420
1694998626,55cyclictest0-21swapper/009:40:070
1694998626,55cyclictest0-21swapper/009:40:070
169499862,55cyclictest1141-21ls08:44:590
169499862,55cyclictest1141-21ls08:44:590
171099855,32cyclictest12510-21/usr/sbin/munin11:00:022
171099855,29cyclictest27369-21if_eth008:25:052
171099855,29cyclictest27369-21if_eth008:25:052
171099854,31cyclictest352-21runrttasks09:04:482
171099854,29cyclictest5819-21latency_hist08:59:442
1710998541,36cyclictest0-21swapper/212:33:332
171099853,38cyclictest28634-21acpi08:29:522
171099853,38cyclictest28634-21acpi08:29:522
171099853,35cyclictest30496-21grep10:35:182
171099853,34cyclictest4017-21cstates07:15:012
171099853,32cyclictest21955-21rm09:30:042
171099853,32cyclictest17683-21ntpq07:56:082
171099853,23cyclictest17749-21/usr/sbin/munin12:00:052
1702998540,38cyclictest27417-21sort10:30:301
1702998532,43cyclictest0-21swapper/108:50:161
1702998532,43cyclictest0-21swapper/108:50:161
169499855,70cyclictest1884-21apt-get07:09:540
169499853,51cyclictest0-21swapper/008:40:050
169499853,51cyclictest0-21swapper/008:40:050
1694998533,43cyclictest0-21swapper/008:55:070
1694998531,47cyclictest0-21swapper/011:10:030
1694998531,47cyclictest0-21swapper/011:10:030
1694998526,54cyclictest0-21swapper/008:19:420
1694998526,54cyclictest0-21swapper/008:19:420
1694998526,52cyclictest0-21swapper/007:54:430
1694998526,52cyclictest0-21swapper/007:54:430
169499852,49cyclictest27051-21ssh10:30:210
171099844,31cyclictest26538-21/usr/sbin/munin12:15:052
171099844,31cyclictest26538-21/usr/sbin/munin12:15:052
171099844,27cyclictest1021-21/usr/sbin/munin08:45:092
171099844,27cyclictest1021-21/usr/sbin/munin08:45:092
171099843,36cyclictest13683-21cpuspeed07:44:572
171099843,36cyclictest12906-21tail07:40:152
171099843,33cyclictest28703-21awk11:25:152
171099843,32cyclictest10218-21latency_hist07:34:442
171099843,31cyclictest8549-21latency_hist07:29:432
171099843,30cyclictest7537-21latency_hist11:44:452
171099843,30cyclictest7537-21latency_hist11:44:452
170299849,63cyclictest17073-21apt-get07:54:561
169499844,71cyclictest28643-21apt-get08:29:570
169499844,71cyclictest28643-21apt-get08:29:570
169499843,65cyclictest4609-21/usr/sbin/munin07:15:170
169499843,65cyclictest12012-21apt-get07:39:550
171099834,34cyclictest28013-21fschecks_count09:40:032
171099834,34cyclictest28013-21fschecks_count09:40:032
171099833,38cyclictest18692-21/usr/sbin/munin08:00:022
171099833,38cyclictest18692-21/usr/sbin/munin08:00:022
171099833,33cyclictest22337-21latency08:10:072
171099833,33cyclictest22337-21latency08:10:072
171099833,32cyclictest32731-21/usr/sbin/munin12:25:052
1710998320,8cyclictest0-21swapper/211:19:512
1710998320,8cyclictest0-21swapper/211:19:512
1715998210,46cyclictest0-21swapper/310:25:003
171099823,31cyclictest16912-21/usr/sbin/munin10:15:042
1702998238,36cyclictest0-21swapper/112:10:121
169499823,69cyclictest27687-21grep08:25:140
169499823,69cyclictest27687-21grep08:25:140
1694998231,44cyclictest0-21swapper/010:35:150
1694998228,48cyclictest0-21swapper/009:55:130
1694998228,48cyclictest0-21swapper/009:55:130
1694998218,57cyclictest13997-21cut07:45:060
1702998136,37cyclictest0-21swapper/108:35:021
1702998136,37cyclictest0-21swapper/108:35:021
1702998128,43cyclictest0-21swapper/107:30:151
170299812,47cyclictest31332-21seq10:37:101
1702998038,35cyclictest0-21swapper/111:50:091
1702998035,37cyclictest0-21swapper/109:55:091
1702998035,37cyclictest0-21swapper/109:55:091
170299802,41cyclictest0-21swapper/110:44:521
170299802,41cyclictest0-21swapper/110:44:521
1694998011,61cyclictest0-21swapper/012:35:110
278952790,20sleep1301ktimers/112:15:521
278952790,20sleep1301ktimers/112:15:521
1702997959,10cyclictest0-21swapper/108:59:431
1702997939,33cyclictest0-21swapper/110:15:081
54482780,6sleep10-21swapper/107:19:441
1702997861,11cyclictest9287-21ssh12:39:431
171599775,40cyclictest0-21swapper/308:20:003
1702997756,14cyclictest797-21systemd-run08:44:411
1702997756,14cyclictest797-21systemd-run08:44:411
1702997740,31cyclictest352-21runrttasks09:17:331
1702997737,32cyclictest0-21swapper/108:15:161
1702997737,32cyclictest0-21swapper/108:15:161
170299773,69cyclictest0-21swapper/109:34:551
1702997736,33cyclictest0-21swapper/112:04:421
1702997735,36cyclictest8855-21kworker/u19:0-writeback11:44:301
1702997734,36cyclictest0-21swapper/110:40:591
1702997731,37cyclictest0-21swapper/109:34:041
1702997637,31cyclictest0-21swapper/108:30:031
1702997637,31cyclictest0-21swapper/108:30:031
1702997634,35cyclictest0-21swapper/111:00:101
169499763,67cyclictest6905-21latency_hist07:24:430
1702997557,11cyclictest0-21swapper/107:39:441
1702997556,11cyclictest0-21swapper/108:10:141
1702997556,11cyclictest0-21swapper/108:10:141
1702997554,10cyclictest0-21swapper/109:40:051
1702997554,10cyclictest0-21swapper/109:40:051
1702997552,11cyclictest0-21swapper/107:44:451
1702997543,22cyclictest0-21swapper/107:45:021
1702997536,32cyclictest0-21swapper/108:00:161
1702997536,32cyclictest0-21swapper/108:00:161
1702997530,38cyclictest0-21swapper/111:30:171
1702997457,10cyclictest3988-21ntp_offset12:30:101
1702997450,17cyclictest0-21swapper/109:25:191
170299743,56cyclictest15631-21ssh11:04:541
1702997431,36cyclictest25869-21latency08:20:351
1715997311,32cyclictest0-21swapper/311:45:043
1715997311,32cyclictest0-21swapper/311:45:043
1702997351,10cyclictest0-21swapper/111:34:571
1702997343,21cyclictest3221-21sh07:14:411
1702997333,33cyclictest0-21swapper/111:21:091
1702997333,33cyclictest0-21swapper/111:21:091
1702997330,32cyclictest0-21swapper/109:04:441
1702997321,43cyclictest8207-21memory10:00:081
1702997252,12cyclictest0-21swapper/111:25:141
1702997230,36cyclictest0-21swapper/110:09:441
1702997153,12cyclictest14504-21kworker/u17:3-rpciod12:09:401
1702997151,10cyclictest0-21swapper/110:49:511
1702997150,11cyclictest1688-21cyclictest11:54:591
1702997150,11cyclictest1688-21cyclictest11:54:591
1702997149,15cyclictest0-21swapper/107:24:431
170299713,61cyclictest0-21swapper/109:04:521
170299712,63cyclictest0-21swapper/108:44:561
170299712,63cyclictest0-21swapper/108:44:561
56627019,35sleep30-21swapper/307:05:483
171599704,44cyclictest0-21swapper/307:55:003
1702997033,30cyclictest0-21swapper/112:20:421
1702997032,33cyclictest0-21swapper/109:10:181
1702997032,33cyclictest0-21swapper/109:10:181
1702996930,32cyclictest0-21swapper/107:50:171
1702996930,32cyclictest0-21swapper/107:50:171
1702996914,48cyclictest20277-21uniq10:20:021
1702996852,9cyclictest0-21swapper/109:50:171
1702996845,10cyclictest0-21swapper/109:24:441
1702996821,40cyclictest8869-21diskmemload12:24:591
1715996350,9cyclictest451rcuc/311:07:173
171599624,45cyclictest14788-21chrt11:55:113
171599624,45cyclictest14788-21chrt11:55:113
1715995943,10cyclictest451rcuc/311:29:443
171599582,21cyclictest4868-21chrt12:31:183
1715995744,8cyclictest451rcuc/310:46:503
1715995744,8cyclictest451rcuc/310:46:503
171599573,42cyclictest7543-21taskset11:44:403
1715995643,8cyclictest451rcuc/312:11:583
1715995643,8cyclictest451rcuc/309:57:023
1715995643,8cyclictest451rcuc/309:57:023
1715995642,9cyclictest451rcuc/310:30:253
171599543,39cyclictest10625-21chrt10:55:333
171599543,39cyclictest10625-21chrt10:55:333
171599543,38cyclictest15093-21chrt09:19:413
171599543,37cyclictest20885-21chrt10:20:153
171599543,36cyclictest1384-21chrt12:25:193
171599543,34cyclictest5836-21chrt08:59:443
171599542,38cyclictest842-21taskset11:33:213
1715995341,8cyclictest451rcuc/312:02:463
1715995340,8cyclictest451rcuc/310:41:153
171599533,37cyclictest19528-21taskset10:19:133
171599533,34cyclictest7058-21chrt07:24:443
1715995331,14cyclictest451rcuc/312:24:023
171599532,38cyclictest2877-21chrt07:10:193
171599524,35cyclictest9257-21chrt12:39:413
1715995240,8cyclictest451rcuc/309:24:083
1715995238,8cyclictest451rcuc/310:53:423
1715995238,8cyclictest451rcuc/309:13:413
1715995238,8cyclictest451rcuc/309:13:413
1715995237,8cyclictest451rcuc/309:51:263
171599523,33cyclictest22196-21chrt08:10:033
171599523,33cyclictest22196-21chrt08:10:033
1715995231,13cyclictest451rcuc/310:04:403
171599522,37cyclictest19528-21chrt11:10:163
171599522,37cyclictest19528-21chrt11:10:163
1715995139,8cyclictest451rcuc/307:28:263
1715995138,9cyclictest451rcuc/311:14:503
171599513,37cyclictest30942-21taskset08:35:143
171599513,37cyclictest30942-21taskset08:35:143
171599513,37cyclictest28633-21taskset08:29:523
171599513,37cyclictest28633-21taskset08:29:523
171599512,39cyclictest23784-21taskset09:33:143
171599512,35cyclictest32059-21chrt08:40:043
171599512,35cyclictest32059-21chrt08:40:043
171599512,32cyclictest27685-21chrt08:25:143
171599512,32cyclictest27685-21chrt08:25:143
171599503,35cyclictest13516-21chrt07:44:443
171599503,34cyclictest7764-21chrt09:05:023
171599503,31cyclictest29468-21taskset10:34:463
171599502,33cyclictest10285-21chrt07:34:443
1715994936,8cyclictest451rcuc/310:10:113
1715994936,8cyclictest451rcuc/310:10:113
171599493,34cyclictest24649-21chrt09:34:523
171599493,34cyclictest20064-21chrt08:04:413
171599493,34cyclictest20064-21chrt08:04:413
171599493,32cyclictest15225-21chrt11:04:323
171599492,36cyclictest13430-21chrt11:53:243
1715994836,8cyclictest451rcuc/309:03:213
1715994835,9cyclictest451rcuc/309:46:493
171599483,35cyclictest1675-21chrt11:34:513
171599483,32cyclictest4312-21chrt07:15:093
171599482,35cyclictest12329-21taskset10:06:293
171599482,34cyclictest28087-21taskset12:16:233
171599482,34cyclictest28087-21taskset12:16:233
171599482,33cyclictest18773-21chrt09:25:043
1715994734,8cyclictest451rcuc/311:22:283
1715994734,8cyclictest451rcuc/311:22:283
1715994733,10cyclictest451rcuc/307:34:533
171599464,28cyclictest21731-21chrt08:09:433
171599464,28cyclictest21731-21chrt08:09:433
1715994633,9cyclictest451rcuc/308:14:543
1715994633,9cyclictest451rcuc/308:14:543
171599463,31cyclictest28558-21chrt09:40:153
171599463,31cyclictest28558-21chrt09:40:153
171599462,32cyclictest1701-21chrt08:45:143
171599462,32cyclictest1701-21chrt08:45:143
171599432,29cyclictest14134-21taskset07:45:093
171599422,31cyclictest16846-21taskset07:54:443
171599422,31cyclictest16846-21taskset07:54:443
171599383,25cyclictest3953-21taskset08:54:173
171599383,25cyclictest3953-21taskset08:54:173
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional