You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-01-05 - 02:42
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the highest latencies:
System rackbslot7.osadl.org (updated Sun Jan 04, 2026 12:44:27)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
713991133,69cyclictest3165-21apt-get07:15:151
7139910860,12cyclictest22589-21ssh10:23:291
2936921080,6sleep20-21swapper/208:35:062
31021056,17sleep20-21swapper/207:06:522
60429918,57sleep0617-21systemd-run07:09:510
713999566,15cyclictest181rcu_preempt12:17:591
717999355,9cyclictest181rcu_preempt11:41:312
717999165,13cyclictest0-21swapper/210:00:122
713999156,7cyclictest181rcu_preempt08:15:271
713999140,19cyclictest2418-21grep08:50:181
713999132,15cyclictest0-21swapper/108:20:111
717999070,13cyclictest8097-21diskmemload11:29:492
713999050,13cyclictest181rcu_preempt10:35:001
713999029,15cyclictest0-21swapper/112:06:091
713998971,12cyclictest20084-21switchtime11:10:251
713998849,9cyclictest181rcu_preempt07:25:221
72199873,61cyclictest14739-21taskset07:50:153
3189328715,37sleep10-21swapper/107:05:161
717998668,9cyclictest0-21swapper/207:24:512
717998665,12cyclictest0-21swapper/208:14:512
717998665,12cyclictest0-21swapper/208:14:512
717998650,7cyclictest181rcu_preempt11:37:522
713998663,15cyclictest291rcuc/110:10:191
713998639,14cyclictest0-21swapper/109:14:591
713998635,31cyclictest0-21swapper/111:20:121
72199855,41cyclictest0-21swapper/310:10:293
713998561,8cyclictest181rcu_preempt12:39:021
713998561,8cyclictest181rcu_preempt12:39:021
713998559,8cyclictest181rcu_preempt08:14:511
713998559,8cyclictest181rcu_preempt08:14:511
713998548,8cyclictest181rcu_preempt10:49:511
713998548,8cyclictest181rcu_preempt10:49:511
713998538,12cyclictest12264-21ssh11:50:071
713998538,12cyclictest12264-21ssh11:50:071
713998536,13cyclictest700-21cyclictest08:25:121
713998532,22cyclictest700-21cyclictest07:40:271
713998530,13cyclictest0-21swapper/110:55:151
709998570,8cyclictest0-21swapper/010:15:280
717998464,12cyclictest0-21swapper/207:55:152
717998458,16cyclictest25501-21/usr/sbin/munin11:20:172
717998410,35cyclictest39-21ksoftirqd/211:12:482
713998436,26cyclictest700-21cyclictest09:51:401
713998426,36cyclictest0-21swapper/111:34:181
72199834,40cyclictest0-21swapper/308:45:203
717998365,8cyclictest0-21swapper/208:59:522
717998365,8cyclictest0-21swapper/208:59:522
717998346,8cyclictest181rcu_preempt10:06:442
713998340,21cyclictest5097-21idleruntime07:20:141
713998338,14cyclictest700-21cyclictest12:21:461
713998331,27cyclictest0-21swapper/111:41:521
71399832,53cyclictest32725-21apt-get08:45:191
713998320,31cyclictest0-21swapper/107:30:221
709998311,14cyclictest13752-21chrt11:51:510
709998311,14cyclictest13752-21chrt11:51:510
72199823,46cyclictest0-21swapper/312:30:183
717998260,15cyclictest24414-21sh09:35:102
717998249,26cyclictest16830-21kworker/u19:2+nfsiod11:45:462
71799822,31cyclictest39-21ksoftirqd/210:20:162
713998260,13cyclictest8621-21ssh10:00:291
713998253,12cyclictest181rcu_preempt09:57:431
713998253,12cyclictest181rcu_preempt09:57:431
713998251,8cyclictest181rcu_preempt07:50:261
713998249,12cyclictest181rcu_preempt11:02:261
713998249,12cyclictest181rcu_preempt11:02:261
717998166,8cyclictest0-21swapper/209:25:072
717998165,8cyclictest0-21swapper/212:05:172
717998165,8cyclictest0-21swapper/208:05:122
717998158,14cyclictest31653-21kworker/u18:2+events_unbound07:44:512
717998149,10cyclictest181rcu_preempt09:46:232
717998144,9cyclictest181rcu_preempt11:56:502
713998152,12cyclictest181rcu_preempt12:30:571
713998150,8cyclictest181rcu_preempt11:19:521
713998146,13cyclictest181rcu_preempt09:00:141
713998146,12cyclictest181rcu_preempt10:05:321
713998145,9cyclictest181rcu_preempt11:35:091
713998144,8cyclictest181rcu_preempt10:54:111
713998142,12cyclictest27066-21latency10:30:181
713998142,12cyclictest27066-21latency10:30:181
713998051,8cyclictest181rcu_preempt11:45:211
713998049,9cyclictest181rcu_preempt11:25:051
713998045,8cyclictest181rcu_preempt07:55:361
713998044,8cyclictest181rcu_preempt10:27:141
713998042,8cyclictest181rcu_preempt11:58:301
72199793,33cyclictest12439-21chrt09:15:253
717997951,9cyclictest181rcu_preempt12:04:482
717997951,9cyclictest181rcu_preempt12:04:482
717997945,7cyclictest181rcu_preempt12:19:282
717997942,7cyclictest181rcu_preempt08:20:062
713997939,12cyclictest1581-21switchtime07:10:241
713997931,30cyclictest0-21swapper/110:42:241
713997930,21cyclictest0-21swapper/110:15:161
713997930,13cyclictest0-21swapper/111:05:421
713997911,21cyclictest291rcuc/108:40:191
72199783,34cyclictest13418-21chrt10:09:463
717997863,8cyclictest0-21swapper/212:30:482
717997848,7cyclictest181rcu_preempt10:38:152
717997847,21cyclictest24136-21sh08:19:492
717997834,14cyclictest181rcu_preempt10:42:282
713997851,13cyclictest181rcu_preempt09:36:061
713997844,7cyclictest181rcu_preempt09:44:381
713997844,7cyclictest181rcu_preempt09:44:381
713997840,12cyclictest181rcu_preempt09:05:141
713997832,20cyclictest0-21swapper/109:20:121
713997831,29cyclictest0-21swapper/109:10:211
713997831,29cyclictest0-21swapper/109:10:211
713997830,16cyclictest0-21swapper/111:59:521
713997830,16cyclictest0-21swapper/111:59:521
70999787,24cyclictest25502-21/usr/sbin/munin11:19:590
709997858,15cyclictest6974-21fschecks_time10:50:120
72199772,33cyclictest1795-21chrt10:41:073
717997755,13cyclictest0-21swapper/208:45:192
717997742,7cyclictest181rcu_preempt09:40:282
717997742,7cyclictest181rcu_preempt09:40:282
717997741,7cyclictest181rcu_preempt08:03:322
717997741,10cyclictest28118-21kworker/u18:1-rpciod08:27:252
717997735,8cyclictest181rcu_preempt12:26:122
717997711,35cyclictest39-21ksoftirqd/211:00:262
717997711,35cyclictest39-21ksoftirqd/211:00:262
713997751,10cyclictest181rcu_preempt08:35:251
713997736,11cyclictest1328-21kworker/u17:1-rpciod12:25:481
713997732,19cyclictest0-21swapper/108:05:181
72199763,45cyclictest0-21swapper/311:30:593
717997659,12cyclictest12515-21kernelversion11:50:152
717997659,12cyclictest12515-21kernelversion11:50:152
717997642,7cyclictest181rcu_preempt10:55:132
713997646,8cyclictest181rcu_preempt09:26:531
713997641,8cyclictest181rcu_preempt07:45:161
713997637,10cyclictest700-21cyclictest12:11:241
713997631,9cyclictest0-21swapper/108:55:061
713997631,9cyclictest0-21swapper/108:55:061
713997626,11cyclictest0-21swapper/109:29:561
709997658,13cyclictest30003-21threads08:35:230
709997621,27cyclictest20600-21rm11:11:040
72199753,36cyclictest29517-21taskset08:35:113
72199753,33cyclictest16914-21chrt09:23:073
72199752,33cyclictest4847-21chrt09:55:163
72199752,33cyclictest4847-21chrt09:55:163
717997561,10cyclictest700-21cyclictest07:45:222
717997546,7cyclictest181rcu_preempt09:14:432
717997546,7cyclictest181rcu_preempt09:14:432
717997542,8cyclictest181rcu_preempt10:53:182
713997527,12cyclictest0-21swapper/107:35:281
709997561,8cyclictest0-21swapper/009:55:270
709997561,8cyclictest0-21swapper/009:55:270
717997446,10cyclictest181rcu_preempt09:31:152
717997435,10cyclictest4046-21ssh09:54:502
713997436,7cyclictest0-21swapper/109:45:241
713997433,10cyclictest0-21swapper/108:00:181
70999748,22cyclictest20707-21if_eth010:20:150
709997456,9cyclictest0-21swapper/011:57:370
709997453,14cyclictest8277-21latency_hist09:09:520
709997416,13cyclictest31830-21timerandwakeup12:20:240
717997345,7cyclictest181rcu_preempt12:23:292
717997343,7cyclictest181rcu_preempt11:08:282
717997341,21cyclictest14296-21/usr/sbin/munin10:10:242
71799732,26cyclictest39-21ksoftirqd/209:15:092
71799731,26cyclictest39-21ksoftirqd/207:29:472
70999737,24cyclictest24306-21/usr/sbin/munin10:25:230
709997351,16cyclictest4522-21idleruntime-cro07:19:490
70999734,33cyclictest0-21swapper/012:01:280
70999734,33cyclictest0-21swapper/012:01:280
709997324,22cyclictest352-21runrttasks10:41:180
709997316,12cyclictest3508-21sshd08:55:020
709997316,12cyclictest3508-21sshd08:55:020
709997315,33cyclictest2934-21rm12:25:590
709997311,37cyclictest0-21swapper/009:44:530
717997257,8cyclictest0-21swapper/207:35:272
717997257,11cyclictest700-21cyclictest10:47:022
717997257,11cyclictest700-21cyclictest10:47:022
717997252,14cyclictest2371-21munin-plugin-st11:34:482
717997231,9cyclictest181rcu_preempt10:18:452
71799722,25cyclictest39-21ksoftirqd/209:20:302
70999725,26cyclictest31594-21dpkg11:29:510
709997246,18cyclictest24435-21kworker/u17:2+nfsiod09:10:440
709997246,18cyclictest24435-21kworker/u17:2+nfsiod09:10:440
709997220,12cyclictest15775-21modprobe11:04:480
709997220,12cyclictest15775-21modprobe11:04:480
717997154,10cyclictest27642-21unixbench_multi10:30:292
717997154,10cyclictest27642-21unixbench_multi10:30:292
717997146,7cyclictest181rcu_preempt09:57:502
717997146,7cyclictest181rcu_preempt09:57:502
717997135,10cyclictest58-21kcompactd007:10:172
71799713,31cyclictest39-21ksoftirqd/207:33:442
717997132,10cyclictest181rcu_preempt12:36:542
717997132,10cyclictest181rcu_preempt12:36:542
713997135,7cyclictest0-21swapper/108:30:231
70999715,22cyclictest15420-21ntpq09:20:210
709997144,20cyclictest22470-21kworker/u17:0+nfsiod09:37:370
709997115,24cyclictest23802-21sh11:16:160
72199703,31cyclictest3648-21chrt09:53:543
717997026,11cyclictest181rcu_preempt11:16:332
71799702,26cyclictest39-21ksoftirqd/210:28:052
709997057,9cyclictest700-21cyclictest10:04:560
709997053,12cyclictest352-21runrttasks12:17:450
70999705,29cyclictest25268-21seq12:10:190
709997017,14cyclictest10895-21idleruntime-cro12:39:480
709997017,14cyclictest10895-21idleruntime-cro12:39:480
717996954,9cyclictest25999-21ssh12:11:042
70999695,20cyclictest13444-21apt-get10:10:000
709996950,12cyclictest161ktimers/011:40:350
709996941,20cyclictest9297-21grep11:45:120
70999692,22cyclictest7248-21ssh12:33:300
709996911,32cyclictest15-21ksoftirqd/008:41:520
72199684,28cyclictest0-21swapper/307:15:173
717996843,15cyclictest0-21swapper/208:30:132
70999685,49cyclictest352-21runrttasks10:47:170
70999685,49cyclictest352-21runrttasks10:47:170
709996854,8cyclictest12685-21ssh10:59:500
709996853,9cyclictest12254-21open_files09:15:220
709996853,9cyclictest10981-21sendmail07:39:490
709996852,11cyclictest26013-21/usr/sbin/munin08:25:180
709996849,13cyclictest24174-21taskset08:19:490
709996822,22cyclictest352-21runrttasks09:32:260
709996821,12cyclictest21938-21/usr/sbin/munin12:05:150
71799673,26cyclictest39-21ksoftirqd/207:17:542
71799672,35cyclictest39-21ksoftirqd/208:40:192
71799672,26cyclictest39-21ksoftirqd/209:01:012
71799671,29cyclictest39-21ksoftirqd/208:50:062
70999673,24cyclictest15-21ksoftirqd/009:42:290
70999671,31cyclictest15-21ksoftirqd/011:06:430
709996710,13cyclictest352-21runrttasks10:00:120
71799662,34cyclictest39-21ksoftirqd/207:49:582
709996650,10cyclictest20933-21systemd-run08:09:490
709996646,12cyclictest2566-21latency_hist07:14:520
709996639,18cyclictest9354-21modprobe07:34:490
70999662,26cyclictest15-21ksoftirqd/011:30:170
709996622,19cyclictest0-21swapper/009:29:400
709996610,23cyclictest15-21ksoftirqd/008:13:450
709996610,23cyclictest15-21ksoftirqd/008:13:450
71799653,26cyclictest39-21ksoftirqd/209:05:082
70999655,24cyclictest15-21ksoftirqd/008:49:490
709996545,13cyclictest8097-21diskmemload11:35:260
70999653,26cyclictest15-21ksoftirqd/009:52:240
70999652,26cyclictest15-21ksoftirqd/010:32:480
70999652,26cyclictest15-21ksoftirqd/010:32:480
709996439,19cyclictest27794-21kworker/u17:2+nfsiod10:36:080
709996439,19cyclictest26867-21kworker/u17:2+nfsiod09:47:310
70999642,31cyclictest15-21ksoftirqd/007:45:310
709996421,16cyclictest0-21swapper/007:51:260
72199633,43cyclictest25923-21chrt11:20:133
70999632,32cyclictest15-21ksoftirqd/007:20:210
70999632,25cyclictest15-21ksoftirqd/007:43:290
72199624,39cyclictest12433-21chrt11:50:123
72199624,39cyclictest12433-21chrt11:50:123
70999627,30cyclictest15-21ksoftirqd/008:31:320
70999624,25cyclictest15-21ksoftirqd/008:00:160
70999622,26cyclictest15-21ksoftirqd/008:51:270
70999622,25cyclictest15-21ksoftirqd/007:59:490
72199614,38cyclictest30736-21chrt09:45:113
709996050,6cyclictest0-21swapper/007:29:520
3502604,14sleep30-21swapper/307:07:223
72199593,41cyclictest20895-21chrt09:29:513
72199593,41cyclictest10734-21chrt10:55:253
72199593,38cyclictest2572-21chrt12:25:253
72199583,42cyclictest26128-21chrt08:25:063
72199583,37cyclictest12774-21chrt07:44:523
70999584,30cyclictest15-21ksoftirqd/008:22:360
70999583,18cyclictest5666-21grep09:00:190
72199564,36cyclictest11423-21chrt09:14:523
72199564,36cyclictest11423-21chrt09:14:523
72199563,33cyclictest29972-21chrt10:35:113
72199562,42cyclictest27692-21taskset10:30:293
72199562,42cyclictest27692-21taskset10:30:293
72199553,38cyclictest16093-21chrt11:55:273
72199552,37cyclictest31433-21chrt12:20:153
72199552,36cyclictest21086-21chrt08:09:513
72199544,33cyclictest23541-21taskset08:15:263
72199543,40cyclictest25127-21taskset09:35:273
72199542,37cyclictest7436-21chrt09:05:243
72199542,37cyclictest21535-21chrt10:20:453
72199542,36cyclictest8505-21chrt10:00:273
72199542,35cyclictest19135-21taskset11:09:523
72199533,37cyclictest2468-21chrt07:14:513
72199533,37cyclictest11644-21taskset11:49:313
72199533,36cyclictest7722-21taskset10:50:273
72199533,35cyclictest28193-21chrt09:40:253
72199533,35cyclictest28193-21chrt09:40:253
72199533,34cyclictest28610-21chrt11:24:553
72199532,36cyclictest23142-21chrt11:15:233
72199532,34cyclictest4434-21taskset11:37:033
72199532,32cyclictest27631-21chrt12:14:523
72199524,34cyclictest7368-21taskset11:41:293
72199523,31cyclictest6298-21chrt07:24:523
72199523,31cyclictest16814-21chrt07:55:173
72199522,38cyclictest8173-21chrt12:35:063
72199522,38cyclictest8173-21chrt12:35:063
72199522,35cyclictest4897-21chrt08:59:493
72199522,35cyclictest4897-21chrt08:59:493
72199522,35cyclictest19964-21chrt12:01:393
72199522,35cyclictest19964-21chrt12:01:393
72199522,33cyclictest5971-21taskset09:00:263
721995216,21cyclictest0-21swapper/308:50:153
72199513,35cyclictest25343-21chrt10:27:293
72199513,35cyclictest19312-21chrt08:04:493
72199512,37cyclictest17685-21taskset10:15:183
72199512,35cyclictest21990-21chrt11:14:423
72199512,35cyclictest15521-21chrt11:04:083
72199512,35cyclictest15521-21chrt11:04:083
72199503,36cyclictest6907-21chrt07:25:163
72199503,34cyclictest22301-21chrt12:05:233
72199502,36cyclictest8004-21chrt07:29:583
721995013,19cyclictest0-21swapper/310:45:273
721995013,19cyclictest0-21swapper/310:45:273
72199492,32cyclictest28254-21chrt08:30:213
72199484,34cyclictest27816-21chrt12:15:083
72199474,31cyclictest21373-21chrt09:30:203
72199463,33cyclictest24578-21chrt08:20:083
72199462,29cyclictest14345-21chrt07:49:513
72199433,31cyclictest22009-21chrt08:10:243
72199433,31cyclictest22009-21chrt08:10:243
72199423,30cyclictest32331-21chrt08:44:513
72199423,29cyclictest9625-21taskset07:35:003
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional