You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-08-15 - 06:57
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the highest latencies:
System rackbslot7.osadl.org (updated Sat Aug 15, 2026 00:44:27)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
2647821369,79sleep026521-21latency19:05:310
27608991193,23cyclictest31619-21ssh23:36:560
276089911448,59cyclictest0-21swapper/023:55:310
276089911448,59cyclictest0-21swapper/023:55:310
27608991142,25cyclictest20136-21taskset21:37:310
27608991132,31cyclictest733-21taskset21:05:500
27608991123,30cyclictest17535-21sh23:15:180
27608991113,36cyclictest14203-21ssh23:10:120
27608991113,25cyclictest1624-21ssh22:50:590
27608991092,25cyclictest10796-21ssh22:14:190
27611991086,72cyclictest1335-21apt-get22:50:151
27608991073,26cyclictest12885-21ssh23:07:290
27608991072,24cyclictest4445-21ssh00:36:210
27608991072,21cyclictest18920-21ssh22:25:480
27608991063,25cyclictest5687-21ssh22:55:540
27608991063,25cyclictest5687-21ssh22:55:540
27608991052,24cyclictest13902-21ssh22:19:110
27608991042,23cyclictest28931-21ssh22:42:110
27608991042,23cyclictest14364-21ssh21:28:520
27608991042,22cyclictest7323-21ssh22:08:310
27608991034,26cyclictest31067-21ssh00:27:330
27608991034,26cyclictest31067-21ssh00:27:330
27608991032,32cyclictest9387-21ssh21:20:300
27608991032,32cyclictest9387-21ssh21:20:300
27608991032,24cyclictest6603-21ssh23:49:470
27608991023,89cyclictest26842-21ssh23:30:120
27608991023,89cyclictest26842-21ssh23:30:120
27608991022,23cyclictest8198-21ssh23:50:470
27608991022,23cyclictest8198-21ssh23:50:470
27608991022,23cyclictest2170-21ssh00:33:360
276089910135,58cyclictest0-21swapper/023:20:370
27608991013,24cyclictest29556-21ssh21:51:420
27608991013,23cyclictest14498-21ssh00:00:420
27608991012,26cyclictest16738-21ssh21:31:500
27608991012,23cyclictest26023-21taskset20:43:220
27608991012,23cyclictest22845-21taskset20:34:110
27611991003,76cyclictest8065-21ssh23:00:401
27611991003,76cyclictest8065-21ssh23:00:401
276089910047,46cyclictest0-21swapper/023:25:370
27608991003,31cyclictest31853-21taskset22:46:340
27608991003,25cyclictest26800-21ssh22:39:540
27608991002,21cyclictest4285-21ssh21:12:390
2748721009,63sleep227502-21systemd-run19:10:022
2760899993,22cyclictest27072-21ssh00:20:370
2760899992,25cyclictest16334-21sh22:22:150
2760899992,22cyclictest10482-21ssh23:04:250
2760899992,22cyclictest10482-21ssh23:04:250
2652329910,60sleep126577-21memory19:05:321
27619999881,10cyclictest0-21swapper/200:05:322
27619999850,41cyclictest19682-21cpu00:10:142
27619999850,41cyclictest19682-21cpu00:10:142
2760899983,28cyclictest9986-21runrttasks19:54:560
2760899982,22cyclictest24765-21ssh00:17:460
2760899982,20cyclictest7062-21ssh21:16:370
2760899973,26cyclictest29746-21munin-node19:15:130
2760899973,23cyclictest24413-21taskset20:38:420
2760899973,22cyclictest11442-21taskset19:57:590
2760899973,21cyclictest2990-21ssh23:43:340
2760899972,32cyclictest31200-21sh21:55:140
2761199963,64cyclictest688-21modprobe21:05:151
27608999640,50cyclictest16488-21/usr/sbin/munin00:05:240
27608999639,51cyclictest0-21swapper/020:50:160
2760899963,32cyclictest22848-21/usr/sbin/munin21:40:590
2760899962,27cyclictest21101-21ssh22:30:210
2760899962,27cyclictest21101-21ssh22:30:210
2760899962,22cyclictest17856-21taskset20:17:200
27611999514,57cyclictest21697-21apt-get21:40:181
27608999541,15cyclictest181rcu_preempt19:35:160
2760899953,22cyclictest27687-21taskset20:49:020
2760899952,25cyclictest14760-21taskset20:08:570
2760899952,21cyclictest353-21runrttasks20:57:230
2760899952,21cyclictest353-21runrttasks20:57:230
2761999942,13cyclictest20918-21ssh22:30:162
2761999942,13cyclictest20918-21ssh22:30:162
2760899943,28cyclictest2800-21/usr/sbin/munin22:00:370
27611999370,15cyclictest204-21systemd-journal23:55:031
2760899933,33cyclictest31279-21sort21:00:120
2760899933,33cyclictest31279-21sort21:00:120
2760899933,27cyclictest15222-21cstates20:10:180
2760899933,25cyclictest611-21apt-get19:25:130
2760899933,22cyclictest21288-21taskset20:29:510
2629029322,42sleep30-21swapper/319:05:263
27619999220,63cyclictest8243-21apt-get22:10:122
2761999914,13cyclictest5090-21ssh22:05:122
2761999913,37cyclictest26604-21latency_hist23:30:022
2760899913,7cyclictest0-21swapper/020:20:150
27608999137,48cyclictest0-21swapper/019:10:230
2760899913,26cyclictest19866-21/usr/sbin/munin00:10:190
2760899913,26cyclictest19866-21/usr/sbin/munin00:10:190
2760899912,27cyclictest32384-21/usr/sbin/munin19:20:360
2761999902,30cyclictest23638-21sh00:15:342
27608999033,49cyclictest0-21swapper/019:47:380
2761999895,41cyclictest25330-21latency21:45:252
2761999895,41cyclictest25330-21latency21:45:252
27619998937,44cyclictest9838-21latency_hist23:55:032
2761999893,38cyclictest31507-21fschecks_time21:00:232
2761999893,38cyclictest31507-21fschecks_time21:00:232
2760899893,27cyclictest2199-21/usr/sbin/munin19:30:200
2760899893,25cyclictest5440-21/usr/sbin/munin19:40:370
2760899892,23cyclictest24897-21cpu21:45:160
2760899892,23cyclictest24897-21cpu21:45:160
2761999883,39cyclictest14805-21modprobe21:30:002
2761999874,35cyclictest12054-21unixbench_multi23:05:362
2761999873,42cyclictest7140-21ssh21:16:492
2761999873,29cyclictest21413-21latency_hist21:40:042
2761999873,29cyclictest1417-21processes23:40:332
27608998737,43cyclictest0-21swapper/020:00:120
2761999864,35cyclictest1567-21grep19:25:382
2761999863,38cyclictest30999-21latency_hist21:55:032
2761999854,37cyclictest24151-21unixbench_singl20:35:392
2761999853,41cyclictest15645-21grep22:20:362
2761999853,37cyclictest13336-21/usr/sbin/munin00:00:222
2761999853,31cyclictest1-21systemd00:00:012
2761999853,31cyclictest1-21systemd00:00:012
2761999852,30cyclictest16092-21grep20:10:372
27619998519,27cyclictest18647-21grep20:20:222
27611998561,17cyclictest27598-21cyclictest20:05:381
2761999844,38cyclictest17958-21latency_hist21:35:022
2761999844,33cyclictest31138-21latency_hist21:00:032
2761999844,33cyclictest31138-21latency_hist21:00:032
2761999844,32cyclictest30331-21/usr/sbin/munin22:45:342
2761999843,39cyclictest1713-21grep21:06:592
2761999843,37cyclictest475-21ssh21:57:152
2761999843,33cyclictest27396-21unixbench_singl20:45:362
2761999843,30cyclictest4496-21wc22:55:142
2761999843,30cyclictest4496-21wc22:55:142
2761999843,27cyclictest29802-21date23:35:032
2761999843,27cyclictest29802-21date23:35:032
27619998413,28cyclictest28155-21cat22:40:362
2761999834,32cyclictest4783-21grep23:45:392
27619998336,39cyclictest0-21swapper/223:40:002
2761999833,37cyclictest353-21runrttasks23:19:342
2761999833,30cyclictest353-21runrttasks20:02:522
2761999833,30cyclictest2118-21df22:00:202
2761999833,27cyclictest627-21cat00:30:322
27611998361,15cyclictest27598-21cyclictest00:16:421
27619998259,17cyclictest2394-21fschecks_count19:30:202
2761999825,26cyclictest14165-21/usr/sbin/munin23:10:402
27619998247,26cyclictest28635-21wc19:10:352
2761999824,42cyclictest26378-21ssh00:20:232
2761999824,37cyclictest18701-21timerwakeupswit22:25:362
2761999824,29cyclictest5879-21sendmail00:40:002
2761999824,26cyclictest10914-21latency_hist23:05:042
2761999824,26cyclictest10914-21latency_hist23:05:042
2761999823,37cyclictest21319-21latency_hist20:30:032
2761999823,36cyclictest21562-21/usr/sbin/munin20:30:152
2761999823,28cyclictest26159-21cron20:45:002
2761999823,25cyclictest31619-21runrttasks19:20:212
27619998232,42cyclictest0-21swapper/219:15:302
2761999814,37cyclictest26843-21latency_hist22:40:032
2761999814,35cyclictest11698-21fschecks_time22:15:222
2761999814,31cyclictest16832-21cstates20:15:182
27619998138,36cyclictest0-21swapper/219:35:242
2761999813,36cyclictest9046-21fschecks_time21:20:222
2761999813,36cyclictest9046-21fschecks_time21:20:222
2761999813,36cyclictest8260-21ssh23:50:572
2761999813,34cyclictest11124-21grep19:55:352
2761999813,25cyclictest20551-21chrt23:20:132
2761999813,24cyclictest2541-21processes22:51:562
2761999812,31cyclictest2635-21fschecks_count21:10:232
27611998157,17cyclictest27598-21cyclictest21:18:361
27611998149,23cyclictest21514-21latency_hist20:30:041
2761199812,33cyclictest31-21ksoftirqd/123:58:131
2761199812,33cyclictest31-21ksoftirqd/123:58:131
2761999803,29cyclictest6788-21kworker/u19:019:45:002
2761999803,28cyclictest29672-21cat00:25:262
2761999803,28cyclictest29672-21cat00:25:262
2761999802,30cyclictest13950-21latency20:05:282
27611998060,11cyclictest30985-21kworker/u17:0-xprtiod21:37:501
27611998058,15cyclictest31154-21cron19:20:001
27611998043,9cyclictest181rcu_preempt20:05:001
2761199802,40cyclictest31-21ksoftirqd/119:32:051
2761199801,47cyclictest31-21ksoftirqd/122:07:081
2762499792,59cyclictest21779-21taskset21:40:233
2761999794,33cyclictest9608-21unixbench_singl19:50:362
2761999792,30cyclictest28552-21ntpq20:50:292
27611997958,16cyclictest27598-21cyclictest21:20:361
27611997958,16cyclictest27598-21cyclictest21:20:361
2761999784,26cyclictest21697-21apt-get21:40:132
27619997834,37cyclictest0-21swapper/219:45:212
27611997756,14cyclictest29375-21munin-node21:15:031
27611997755,16cyclictest5169-21idleruntime-cro19:40:011
27611997753,16cyclictest656-21sh21:57:441
27611997752,13cyclictest0-21swapper/122:25:171
27611997751,7cyclictest181rcu_preempt21:30:081
2761199772,45cyclictest31-21ksoftirqd/123:44:461
27611997654,12cyclictest0-21swapper/119:45:191
27611997652,16cyclictest27925-21latency_hist21:50:041
27611997652,16cyclictest27925-21latency_hist21:50:041
2761199764,29cyclictest31-21ksoftirqd/120:15:031
27611997626,36cyclictest287-21dbus-daemon21:05:011
27611997626,36cyclictest287-21dbus-daemon21:05:011
27611997554,14cyclictest27598-21cyclictest19:40:211
27611997552,16cyclictest27598-21cyclictest23:38:541
27611997534,23cyclictest0-21swapper/122:10:351
27611997533,27cyclictest31-21ksoftirqd/100:38:531
27611997521,24cyclictest31-21ksoftirqd/120:45:291
2761199746,42cyclictest31-21ksoftirqd/100:29:101
2761199746,42cyclictest31-21ksoftirqd/100:29:101
27611997449,13cyclictest0-21swapper/123:15:191
27611997357,11cyclictest27598-21cyclictest21:26:451
27611997352,16cyclictest875-21apt-key22:50:031
2761199733,41cyclictest31-21ksoftirqd/100:34:451
2761199732,40cyclictest31-21ksoftirqd/100:11:581
2761199732,40cyclictest31-21ksoftirqd/100:11:581
27611997248,17cyclictest21800-21fschecks_time20:30:201
2761199722,36cyclictest31-21ksoftirqd/122:35:441
27611997222,21cyclictest291rcuc/119:50:191
27611997145,12cyclictest181rcu_preempt20:50:331
27611997125,33cyclictest7580-21sed23:00:041
27611997125,33cyclictest7580-21sed23:00:041
27611997049,14cyclictest353-21runrttasks23:45:421
27611997037,12cyclictest181rcu_preempt21:52:221
2761199702,39cyclictest31-21ksoftirqd/100:08:321
27611996949,7cyclictest181rcu_preempt23:23:071
27611996949,7cyclictest181rcu_preempt00:00:301
2761199694,37cyclictest31-21ksoftirqd/122:24:131
27611996936,12cyclictest181rcu_preempt22:01:291
2761199692,39cyclictest31-21ksoftirqd/123:14:121
27611996919,28cyclictest31-21ksoftirqd/119:10:161
27611996847,7cyclictest181rcu_preempt20:55:281
27611996847,7cyclictest181rcu_preempt20:55:281
27611996836,11cyclictest181rcu_preempt23:29:561
27611996818,21cyclictest291rcuc/120:40:281
27611996752,10cyclictest27598-21cyclictest00:20:591
27611996749,11cyclictest12369-21runrttasks23:06:091
27611996745,8cyclictest181rcu_preempt22:40:281
27611996740,17cyclictest865-21cut19:25:231
2762499663,32cyclictest0-21swapper/323:00:413
2762499663,32cyclictest0-21swapper/323:00:413
27624996627,25cyclictest22750-21taskset20:32:593
27624996625,28cyclictest20214-21taskset00:10:263
27624996625,28cyclictest20214-21taskset00:10:263
2761199664,39cyclictest31-21ksoftirqd/123:32:151
2761199664,39cyclictest31-21ksoftirqd/123:32:151
2761199663,29cyclictest31-21ksoftirqd/123:50:281
2761199662,34cyclictest14255-21cut22:20:001
27624996525,26cyclictest18373-21taskset20:20:113
27611996544,7cyclictest181rcu_preempt19:55:301
27611996524,9cyclictest2039-21diskmemload22:30:481
27611996524,9cyclictest2039-21diskmemload22:30:481
27624996427,25cyclictest1905-21chrt23:40:483
27624996424,28cyclictest30083-21taskset21:53:033
2762499642,41cyclictest0-21swapper/322:50:173
2761199646,43cyclictest23368-21fschecks_count20:35:241
27624996333,20cyclictest23720-21chrt22:35:003
27624996333,20cyclictest23720-21chrt22:35:003
27624996331,20cyclictest31067-21chrt23:35:383
27624996327,23cyclictest24976-21chrt20:40:203
27624996326,25cyclictest27341-21taskset00:21:123
27611996343,15cyclictest27598-21cyclictest20:25:041
2761199633,43cyclictest31678-21fschecks_time19:20:221
2761199632,36cyclictest31-21ksoftirqd/120:15:331
27624996226,24cyclictest6829-21taskset22:58:513
27624996226,24cyclictest6829-21taskset22:58:513
27624996226,23cyclictest20933-21chrt21:39:343
27624996224,25cyclictest13326-21taskset00:00:093
27624996128,20cyclictest8465-21chrt21:20:003
27624996126,24cyclictest29568-21chrt00:25:253
27624996126,24cyclictest29568-21chrt00:25:253
27624996125,25cyclictest4492-21chrt22:04:213
27624996123,25cyclictest24980-21taskset23:26:063
27624996122,25cyclictest18149-21chrt23:15:323
27624996027,21cyclictest2393-21chrt21:10:163
27624996025,24cyclictest1561-21taskset22:00:003
27624996025,23cyclictest15165-21chrt21:30:143
27624996025,21cyclictest26860-21chrt23:30:153
27624996025,21cyclictest26860-21chrt23:30:153
27624996024,24cyclictest9768-21taskset23:54:503
27624996024,24cyclictest9768-21taskset23:54:503
27624996023,24cyclictest29055-21taskset20:50:563
27624995929,19cyclictest16784-21chrt20:15:173
27624995928,21cyclictest20217-21chrt20:25:223
27624995928,21cyclictest16703-21chrt00:05:193
27624995928,20cyclictest12573-21chrt23:06:413
27624995927,20cyclictest31569-21chrt21:00:233
27624995927,20cyclictest31569-21chrt21:00:233
27624995927,20cyclictest26636-21chrt20:45:223
27624995926,22cyclictest27570-21chrt21:49:433
27624995926,22cyclictest27570-21chrt21:49:433
27624995923,25cyclictest26325-21taskset22:38:413
27624995922,24cyclictest4746-21taskset00:37:083
2762499583,37cyclictest0-21swapper/321:05:553
27624995827,20cyclictest12169-21chrt23:57:543
27624995827,20cyclictest12169-21chrt23:57:543
27624995826,21cyclictest15159-21chrt23:10:383
27624995826,20cyclictest5140-21chrt19:39:543
27624995826,20cyclictest16235-21chrt22:22:003
27624995825,21cyclictest30982-21chrt19:17:473
27624995825,21cyclictest11230-21taskset22:15:033
27624995825,20cyclictest6438-21chrt19:40:393
27624995825,20cyclictest12357-21chrt21:25:233
27624995727,19cyclictest28575-21chrt19:10:343
27624995725,21cyclictest27571-21chrt22:40:233
27624995725,21cyclictest23184-21chrt20:35:133
27624995725,20cyclictest8383-21chrt19:49:583
27624995725,20cyclictest10527-21chrt21:22:153
27624995725,20cyclictest10527-21chrt21:22:153
27624995725,19cyclictest1622-21chrt19:25:533
2762499572,42cyclictest20716-21taskset23:20:183
27624995724,21cyclictest32529-21chrt22:48:173
27624995724,21cyclictest13145-21chrt22:17:143
27624995723,22cyclictest6259-21taskset22:05:473
27624995723,22cyclictest14721-21chrt20:08:253
2762499563,32cyclictest4179-21taskset23:45:223
27624995626,20cyclictest17744-21chrt22:25:123
27624995625,20cyclictest31903-21chrt19:20:263
27624995625,20cyclictest16143-21chrt20:11:043
27624995624,20cyclictest9750-21chrt19:51:533
27624995623,21cyclictest3302-21chrt19:31:523
27624995622,22cyclictest1954-21chrt00:33:033
27624995622,22cyclictest12906-21chrt20:00:483
27624995438,9cyclictest0-21swapper/300:15:123
27624995425,19cyclictest29830-21chrt20:55:213
27624995425,19cyclictest29830-21chrt20:55:213
27624995425,19cyclictest10277-21chrt19:55:133
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional