You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-08-04 - 23:55
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the highest latencies:
System rackbslot7.osadl.org (updated Tue Aug 04, 2026 12:44:34)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
5705210412,63sleep25732-21/usr/sbin/munin06:51:182
5705210412,63sleep25732-21/usr/sbin/munin06:51:182
308402980,28sleep3451rcuc/312:05:353
6635999712,57cyclictest39-21ksoftirqd/208:37:152
6635999269,14cyclictest30344-21idleruntime-cro11:10:362
513229013,32sleep10-21swapper/106:50:481
513229013,32sleep10-21swapper/106:50:481
6630998972,11cyclictest29750-21fschecks_count09:20:591
6635998820,36cyclictest39-21ksoftirqd/207:14:152
6626998843,32cyclictest5675-21modprobe08:30:360
6626998828,30cyclictest29384-21rm11:07:550
6635998755,8cyclictest181rcu_preempt11:33:182
6635998755,8cyclictest181rcu_preempt11:33:182
6630998723,26cyclictest2690-21seq08:20:431
6626998718,27cyclictest20616-21ssh11:47:300
663599863,59cyclictest16998-21apt-get09:00:512
663599863,59cyclictest16998-21apt-get09:00:512
6635998614,45cyclictest39-21ksoftirqd/208:49:292
6635998612,42cyclictest39-21ksoftirqd/209:54:492
6626998648,17cyclictest28879-21processes12:01:080
6626998621,47cyclictest0-21swapper/009:34:290
6626998618,27cyclictest13923-21ssh10:41:590
6626998617,29cyclictest19061-21rm09:02:240
6626998617,29cyclictest19061-21rm09:02:240
6626998617,28cyclictest4923-21ssh10:27:150
6626998617,28cyclictest4923-21ssh10:27:150
6626998617,28cyclictest26722-21rm11:03:510
64712869,48sleep03093-21kworker/u17:4+flush-179:006:55:370
64712869,48sleep03093-21kworker/u17:4+flush-179:006:55:370
6635998516,43cyclictest39-21ksoftirqd/210:22:142
6630998539,22cyclictest23659-21sendmail10:05:361
6630998539,22cyclictest23659-21sendmail10:05:361
6626998568,11cyclictest14012-21diskmemload09:46:030
6626998568,11cyclictest14012-21diskmemload09:46:030
6626998519,39cyclictest8833-21runrttasks08:39:470
6626998519,28cyclictest21838-21ssh09:06:450
6626998517,26cyclictest20718-21ssh10:53:410
6626998516,34cyclictest16236-21seq08:58:290
6635998458,17cyclictest352-21runrttasks11:25:392
6635998458,17cyclictest352-21runrttasks11:25:392
663599842,58cyclictest32195-21apt-get09:25:522
6626998443,30cyclictest0-21swapper/011:26:080
6626998417,24cyclictest29430-21ssh10:14:420
6626998417,24cyclictest29430-21ssh10:14:420
6626998416,30cyclictest17670-21ssh10:48:250
6626998416,30cyclictest17670-21ssh10:48:250
6630998361,11cyclictest26213-21latency_hist09:15:411
6626998336,18cyclictest23789-21sh10:58:580
6626998336,18cyclictest23789-21sh10:58:580
6626998321,21cyclictest6127-21seq11:23:450
6626998321,21cyclictest6127-21seq11:23:450
6626998320,23cyclictest15343-21ssh11:39:310
6626998318,28cyclictest6712-21rm12:18:530
6626998316,26cyclictest30889-21rm09:22:000
6626998315,28cyclictest27914-21ssh09:17:010
6635998257,19cyclictest18968-21latency_hist07:30:402
6635998257,19cyclictest18968-21latency_hist07:30:402
6635998218,38cyclictest39-21ksoftirqd/212:16:352
6635998211,46cyclictest39-21ksoftirqd/211:37:382
6626998264,12cyclictest1-21systemd10:35:360
6626998220,22cyclictest10827-21ssh09:42:550
6626998217,27cyclictest23524-21ssh11:51:410
6626998217,27cyclictest23524-21ssh11:51:410
6626998216,26cyclictest3167-21seq12:12:170
6626998216,26cyclictest3167-21seq12:12:170
6635998147,8cyclictest181rcu_preempt11:27:322
6630998159,14cyclictest13764-21processes11:36:101
6626998119,23cyclictest26550-21runrttasks10:10:240
6626998119,23cyclictest19266-21ssh09:56:340
6626998117,27cyclictest821-21ssh12:09:030
6626998117,25cyclictest3468-21ssh11:19:380
6626998117,23cyclictest10161-21ssh12:25:160
6626998117,23cyclictest10161-21ssh12:25:160
6626998116,28cyclictest7546-21rm09:37:000
6626998116,24cyclictest25291-21rm09:13:030
6626998116,22cyclictest11154-21taskset10:37:330
6626998116,22cyclictest11154-21taskset10:37:330
6626998116,22cyclictest11154-21taskset10:37:330
6626998116,20cyclictest7172-21seq08:34:080
6626998115,25cyclictest29976-21taskset08:04:490
6626998114,27cyclictest31918-21ssh10:18:260
663599809,61cyclictest13434-21apt-get07:15:522
6635998056,7cyclictest181rcu_preempt11:46:062
6635998019,37cyclictest39-21ksoftirqd/212:02:282
6626998018,21cyclictest26403-21ssh11:56:260
6626998017,21cyclictest28404-21seq08:00:250
6626998017,21cyclictest28404-21seq08:00:250
6626998016,26cyclictest1808-21rm09:27:330
6626998016,26cyclictest16473-21runrttasks09:52:010
6626998016,23cyclictest32076-21ssh11:12:080
6635997943,20cyclictest23892-21fw_packets09:11:022
6630997961,11cyclictest30251-21kworker/u17:1-rpciod11:21:151
6630997961,11cyclictest30251-21kworker/u17:1-rpciod11:21:151
6626997935,7cyclictest181rcu_preempt11:41:200
6626997916,24cyclictest8100-21seq07:00:130
6626997916,22cyclictest23502-21seq07:44:460
6635997863,9cyclictest20373-21awk07:35:362
6635997861,11cyclictest12700-21ssh09:46:082
6635997861,11cyclictest12700-21ssh09:46:082
6635997857,14cyclictest14012-21diskmemload10:25:592
6635997857,14cyclictest14012-21diskmemload10:25:592
6635997849,13cyclictest181rcu_preempt11:02:192
6635997821,33cyclictest39-21ksoftirqd/210:20:032
6635997821,32cyclictest39-21ksoftirqd/208:32:252
6635997814,39cyclictest39-21ksoftirqd/207:57:172
6635997814,39cyclictest39-21ksoftirqd/207:57:172
6630997818,25cyclictest352-21runrttasks11:58:271
662699788,26cyclictest18678-21runrttasks07:29:470
662699788,26cyclictest18678-21runrttasks07:29:470
6626997847,22cyclictest21974-21sh07:40:360
6626997821,48cyclictest10140-21ssh11:30:510
6626997821,48cyclictest10140-21ssh11:30:510
6626997819,24cyclictest10578-21seq08:43:340
6626997819,24cyclictest10578-21seq08:43:340
6626997817,47cyclictest6614-21cyclictest08:13:540
6626997815,26cyclictest25106-21taskset07:49:180
6635997743,10cyclictest181rcu_preempt12:21:182
6635997743,10cyclictest181rcu_preempt12:21:182
6635997716,37cyclictest39-21ksoftirqd/208:42:362
6635997716,37cyclictest39-21ksoftirqd/208:42:362
6630997761,10cyclictest31283-21unixbench_singl08:06:131
6630997757,14cyclictest9155-21apt-key10:35:391
251092770,4sleep3451rcuc/311:01:023
6635997649,8cyclictest181rcu_preempt09:35:212
6635997628,12cyclictest0-21swapper/208:29:182
6635997621,31cyclictest39-21ksoftirqd/209:08:472
6635997614,31cyclictest39-21ksoftirqd/207:04:432
6630997659,11cyclictest19960-21ssh09:58:331
6630997623,19cyclictest28322-21ntp_states11:06:101
6626997617,24cyclictest3883-21seq08:23:340
6635997548,9cyclictest181rcu_preempt10:37:412
6635997548,9cyclictest181rcu_preempt10:37:412
6635997548,9cyclictest181rcu_preempt10:37:412
6635997546,7cyclictest181rcu_preempt10:15:462
6635997546,7cyclictest181rcu_preempt10:15:462
6635997530,12cyclictest0-21swapper/210:58:132
6635997530,12cyclictest0-21swapper/210:58:132
6635997515,36cyclictest39-21ksoftirqd/208:15:362
6630997555,14cyclictest26319-21sh10:09:441
6626997519,23cyclictest19005-21seq07:30:440
6635997451,10cyclictest181rcu_preempt09:59:442
6635997448,9cyclictest181rcu_preempt07:53:202
6635997448,9cyclictest181rcu_preempt07:53:202
6635997440,9cyclictest181rcu_preempt11:54:242
6635997440,9cyclictest181rcu_preempt11:54:242
6630997459,8cyclictest0-21swapper/109:06:131
6630997456,13cyclictest19785-21threads07:31:131
6630997452,16cyclictest5853-21idleruntime-cro09:35:361
6626997417,24cyclictest10174-21seq07:05:320
6626997416,22cyclictest23585-21sh10:05:270
6626997416,22cyclictest23585-21sh10:05:270
6635997348,16cyclictest17233-21latency_hist07:25:392
6635997348,10cyclictest181rcu_preempt10:55:312
6635997340,10cyclictest6369-21ssh09:35:582
6635997336,10cyclictest19676-21snmpd11:12:522
6635997327,23cyclictest0-21swapper/208:19:472
6635997327,23cyclictest0-21swapper/208:19:472
6635997320,30cyclictest39-21ksoftirqd/207:10:262
6635997316,31cyclictest39-21ksoftirqd/206:56:172
6635997316,28cyclictest39-21ksoftirqd/207:43:442
6635997312,36cyclictest39-21ksoftirqd/210:33:332
6630997358,10cyclictest6614-21cyclictest08:01:131
6630997353,14cyclictest30638-21ntp_kernel_pll_10:16:071
6630997322,19cyclictest816-21seq08:15:321
6626997310,26cyclictest2111-21chrt08:16:250
6626997310,26cyclictest2111-21chrt08:16:250
6635997247,16cyclictest297-21systemd-logind08:10:372
6635997240,7cyclictest181rcu_preempt09:42:382
6635997237,20cyclictest30663-21ssh09:21:222
663599723,60cyclictest15878-21ssh10:46:032
663599723,60cyclictest15878-21ssh10:46:032
6635997231,10cyclictest0-21swapper/212:13:392
6635997231,10cyclictest0-21swapper/212:13:392
6635997216,34cyclictest39-21ksoftirqd/210:10:142
6635997215,31cyclictest39-21ksoftirqd/210:44:122
6630997252,13cyclictest8820-21latency_hist09:40:391
6630997232,35cyclictest0-21swapper/110:20:541
6630997222,19cyclictest28113-21seq07:56:321
6630997222,19cyclictest28113-21seq07:56:321
6630997222,18cyclictest9998-21seq07:03:171
6630997220,18cyclictest11307-21seq07:06:131
6630997218,24cyclictest352-21runrttasks08:35:411
6630997216,25cyclictest0-21swapper/108:35:051
663599712,38cyclictest21254-21grep07:36:092
6635997118,31cyclictest39-21ksoftirqd/208:51:362
6630997154,10cyclictest15599-21apt-config07:20:401
6630997152,12cyclictest6312-21latency_hist10:30:401
6630997152,12cyclictest6312-21latency_hist10:30:401
6630997134,31cyclictest0-21swapper/109:26:061
6630997123,22cyclictest25082-21seq07:48:591
6626997118,22cyclictest16804-21seq07:21:370
6626997118,17cyclictest2207-21ssh10:22:550
6626997116,24cyclictest25473-21/usr/sbin/munin07:50:570
6626997116,24cyclictest25473-21/usr/sbin/munin07:50:570
6626997111,20cyclictest0-21swapper/007:10:060
6635997048,7cyclictest181rcu_preempt09:16:142
6635997045,7cyclictest181rcu_preempt10:04:122
6635997045,7cyclictest181rcu_preempt10:04:122
6635997040,21cyclictest30219-21latency_hist08:05:392
6635997037,9cyclictest181rcu_preempt12:07:322
6635997014,31cyclictest39-21ksoftirqd/211:43:312
6630997054,10cyclictest14922-21ntp_kernel_pll_08:56:071
6630997034,31cyclictest0-21swapper/111:15:521
6630997034,25cyclictest15789-21apt-get10:46:041
6630997034,25cyclictest15789-21apt-get10:46:041
663099703,26cyclictest16392-21processes07:21:281
6630997020,18cyclictest13868-21seq08:54:071
6626997052,12cyclictest277-21dbus-daemon08:55:380
6626997016,23cyclictest13921-21/usr/sbin/munin07:16:400
6635996931,7cyclictest0-21swapper/211:57:092
663099699,24cyclictest0-21swapper/110:12:221
663099699,24cyclictest0-21swapper/110:12:221
6630996950,13cyclictest4528-21fschecks_count08:25:581
6630996950,13cyclictest2374-21systemd-journal12:22:371
6630996950,13cyclictest2374-21systemd-journal12:22:371
6630996926,30cyclictest24552-21seq11:54:381
6630996926,30cyclictest24552-21seq11:54:381
6630996913,23cyclictest0-21swapper/109:52:071
6630996912,28cyclictest21761-21runrttasks07:38:011
6626996913,20cyclictest352-21runrttasks07:12:410
6635996832,9cyclictest0-21swapper/208:56:372
663099688,23cyclictest0-21swapper/112:02:001
6630996848,14cyclictest14012-21diskmemload10:35:411
6630996848,14cyclictest14012-21diskmemload10:35:411
6630996848,14cyclictest14012-21diskmemload10:35:411
6630996823,22cyclictest31668-21unixbench_multi11:11:151
6630996816,19cyclictest14821-21ssh09:50:381
6630996816,19cyclictest14821-21ssh09:50:381
6630996815,19cyclictest14012-21diskmemload10:44:501
6630996814,18cyclictest14012-21diskmemload09:18:141
6626996812,20cyclictest0-21swapper/008:10:300
6630996751,8cyclictest0-21swapper/112:15:361
6630996751,8cyclictest0-21swapper/112:15:361
6630996748,13cyclictest31373-21sh12:05:561
663099673,47cyclictest19016-21fschecks_count10:51:001
6630996718,21cyclictest14012-21diskmemload11:27:391
6630996717,22cyclictest352-21runrttasks07:55:111
6630996717,22cyclictest352-21runrttasks07:55:111
6630996716,23cyclictest352-21runrttasks07:41:541
6630996710,23cyclictest0-21swapper/109:05:401
6630996710,23cyclictest0-21swapper/109:05:401
6635996613,22cyclictest381ktimers/211:16:062
6630996629,28cyclictest0-21swapper/107:10:491
6630996627,34cyclictest0-21swapper/111:00:521
6635996525,9cyclictest0-21swapper/207:46:092
6635996524,19cyclictest0-21swapper/208:22:342
6630996531,24cyclictest7390-21grep06:56:091
6630996528,31cyclictest0-21swapper/111:45:471
6630996526,27cyclictest22891-21seq10:56:251
6630996526,27cyclictest22891-21seq10:56:251
6630996516,19cyclictest352-21runrttasks11:33:371
6630996516,19cyclictest352-21runrttasks11:33:371
6630996515,29cyclictest352-21runrttasks07:26:471
6630996515,29cyclictest352-21runrttasks07:26:471
6626996511,23cyclictest0-21swapper/008:49:530
6630996448,10cyclictest17088-21unixbench_multi11:41:151
6630996421,19cyclictest5893-21seq12:16:351
6630996332,22cyclictest10740-21modprobe08:45:361
6630996332,22cyclictest10740-21modprobe08:45:361
6630996220,19cyclictest12221-21seq08:48:321
6630996129,24cyclictest9178-21sh09:40:541
6630996118,31cyclictest1327-21fschecks_count08:15:591
6630996118,31cyclictest1327-21fschecks_count08:15:591
6640996048,8cyclictest451rcuc/307:15:493
664099545,21cyclictest0-21swapper/311:50:553
664099545,21cyclictest0-21swapper/311:50:553
664099523,33cyclictest20501-21chrt09:05:413
664099522,35cyclictest27210-21chrt10:10:543
664099522,35cyclictest27210-21chrt10:10:543
505425211,25sleep30-21swapper/306:50:423
505425211,25sleep30-21swapper/306:50:423
664099513,35cyclictest2015-21chrt09:28:083
664099513,29cyclictest0-21swapper/310:46:033
664099513,29cyclictest0-21swapper/310:46:033
664099512,37cyclictest3491-21chrt10:25:503
664099512,37cyclictest3491-21chrt10:25:503
664099512,34cyclictest8824-21chrt07:00:493
6640995037,9cyclictest451rcuc/309:21:523
664099503,34cyclictest19696-21taskset11:46:093
664099503,33cyclictest7910-21taskset12:20:593
664099503,33cyclictest7910-21taskset12:20:593
664099503,32cyclictest30462-21taskset11:10:393
6640995027,15cyclictest451rcuc/308:38:533
664099502,36cyclictest7248-21taskset11:25:553
664099493,33cyclictest30641-21chrt11:10:473
664099493,31cyclictest11325-21taskset10:38:033
664099493,31cyclictest11325-21taskset10:38:033
664099493,31cyclictest11325-21taskset10:38:033
6640994933,10cyclictest45052sleep308:25:563
664099492,33cyclictest22860-21chrt10:56:203
664099492,33cyclictest22860-21chrt10:56:203
664099482,33cyclictest7368-21chrt10:31:133
6640994734,9cyclictest451rcuc/307:49:243
6640994734,8cyclictest451rcuc/309:02:553
6640994734,8cyclictest451rcuc/309:02:553
6640994632,9cyclictest451rcuc/309:44:073
664099463,29cyclictest23825-21chrt09:11:013
664099462,33cyclictest19035-21taskset07:30:513
664099462,33cyclictest13685-21chrt07:15:403
664099462,31cyclictest27938-21taskset09:17:053
664099462,31cyclictest15013-21chrt10:45:043
664099462,30cyclictest11856-21chrt07:10:373
664099453,31cyclictest22938-21chrt07:41:123
664099453,28cyclictest20098-21taskset10:51:543
6640994531,9cyclictest451rcuc/308:01:473
6640994526,12cyclictest451rcuc/310:22:143
6640994525,13cyclictest451rcuc/308:49:293
664099443,28cyclictest3114-21chrt11:18:383
664099443,28cyclictest12744-21chrt09:46:093
664099443,28cyclictest12744-21chrt09:46:093
664099443,26cyclictest21285-21taskset10:01:003
664099443,26cyclictest21285-21taskset10:01:003
6640994430,10cyclictest451rcuc/311:36:383
664099442,32cyclictest5283-21chrt11:21:213
664099442,32cyclictest5283-21chrt11:21:213
664099433,31cyclictest17153-21taskset07:25:373
664099433,30cyclictest15696-21chrt08:56:583
664099433,29cyclictest26442-21chrt10:10:053
664099433,26cyclictest15093-21taskset09:50:473
664099433,25cyclictest4143-21taskset12:15:033
664099433,25cyclictest4143-21taskset12:15:033
6640994328,9cyclictest451rcuc/307:50:493
6640994328,9cyclictest451rcuc/307:50:493
6640994326,11cyclictest451rcuc/308:16:343
6640994326,11cyclictest451rcuc/308:16:343
6640994324,12cyclictest451rcuc/307:36:363
664099432,27cyclictest27712-21chrt07:56:113
664099432,27cyclictest27712-21chrt07:56:113
664099423,30cyclictest27031-21chrt11:58:143
664099423,27cyclictest31974-21chrt10:18:363
664099423,27cyclictest18648-21chrt11:45:283
664099423,25cyclictest4052-21taskset08:25:363
6640994225,12cyclictest451rcuc/308:40:483
6640994225,12cyclictest451rcuc/308:40:483
664099422,29cyclictest10131-21chrt11:30:493
664099422,29cyclictest10131-21chrt11:30:493
664099422,27cyclictest851-21chrt12:09:083
664099422,25cyclictest8190-21chrt09:38:513
664099422,25cyclictest6899-21chrt12:19:253
664099413,29cyclictest4753-21taskset09:32:303
664099413,29cyclictest19481-21chrt09:57:113
664099413,26cyclictest14187-21taskset08:55:403
664099412,29cyclictest7318-21chrt08:35:363
664099403,23cyclictest18924-21chrt07:30:393
664099403,23cyclictest18924-21chrt07:30:393
6640994027,8cyclictest451rcuc/308:11:523
664099393,27cyclictest30494-21chrt08:05:553
664099393,24cyclictest6784-21chrt06:55:433
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional