You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-05-18 - 16:12
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the 792 highest latencies:
System rackbslot7.osadl.org (updated Mon May 18, 2026 12:44:31)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
1783921629,20sleep00-21swapper/006:56:210
1783921629,20sleep00-21swapper/006:56:210
191589910660,39cyclictest0-21swapper/112:20:441
19158999966,13cyclictest3851-21ssh10:11:111
1915899977,79cyclictest27945-21apt-get10:51:101
1915899977,79cyclictest27945-21apt-get10:51:101
190682979,60sleep119092-21latency_hist07:00:591
190682979,60sleep119092-21latency_hist07:00:591
176552947,64sleep20-21swapper/206:56:072
176552947,64sleep20-21swapper/206:56:072
19158999367,18cyclictest10126-21latency_hist08:10:591
19149999252,8cyclictest181rcu_preempt09:56:330
19149999252,8cyclictest181rcu_preempt09:56:330
19158999072,11cyclictest7735-21fschecks_time11:11:161
19158998937,12cyclictest0-21swapper/107:06:431
19158998937,12cyclictest0-21swapper/107:06:431
19149998973,9cyclictest18425-21ssh12:21:580
19162998817,31cyclictest15748-21cut09:36:212
19162998759,21cyclictest27900-21kworker/u19:0+nfsiod11:11:172
19162998636,28cyclictest0-21swapper/212:20:342
19162998463,14cyclictest19909-21kworker/u17:3-rpciod09:51:212
19162998415,32cyclictest23801-21grep08:51:172
19162998415,32cyclictest23801-21grep08:51:172
1914999844,51cyclictest15-21ksoftirqd/011:05:290
1916299837,32cyclictest0-21swapper/209:58:512
1916299837,32cyclictest0-21swapper/209:58:512
19162998324,26cyclictest30951-21taskset09:06:342
19162998319,26cyclictest2469-21runrttasks07:46:152
19162998319,26cyclictest2469-21runrttasks07:46:152
19162998317,33cyclictest2043-21ls07:45:552
19162998315,33cyclictest21159-21munin-node07:06:012
19162998315,33cyclictest21159-21munin-node07:06:012
19158998363,14cyclictest31849-21fschecks_time07:37:151
19158998325,11cyclictest0-21swapper/107:31:111
19149998363,14cyclictest15755-21kernelversion09:36:210
19162998257,16cyclictest352-21runrttasks10:52:202
19162998257,16cyclictest352-21runrttasks10:52:202
19162998214,32cyclictest24566-21cat10:45:582
19162998214,32cyclictest24566-21cat10:45:582
19158998263,12cyclictest2374-21systemd-journal09:10:561
19158998251,9cyclictest181rcu_preempt07:21:111
1914999826,39cyclictest15-21ksoftirqd/007:21:210
1817728223,33sleep30-21swapper/306:56:323
1817728223,33sleep30-21swapper/306:56:323
19162998113,34cyclictest1764-21fschecks_time11:01:172
19158998157,15cyclictest5249-21rm12:01:211
19158998132,12cyclictest181rcu_preempt08:47:211
19149998165,12cyclictest19140-21cyclictest09:06:150
19149998156,17cyclictest20962-21apt-key07:05:590
19162998026,19cyclictest26576-21sh09:00:552
19162998018,29cyclictest22638-21grep08:47:252
19158998053,8cyclictest181rcu_preempt07:26:071
19158998051,22cyclictest29730-21kworker/u19:3+events_unbound09:15:551
19158998048,9cyclictest181rcu_preempt11:21:501
19158998016,30cyclictest5743-21fschecks_count07:56:161
1914999805,30cyclictest15-21ksoftirqd/010:16:490
1914999803,45cyclictest15-21ksoftirqd/011:41:320
19149998030,29cyclictest15-21ksoftirqd/012:16:260
19149998016,33cyclictest15-21ksoftirqd/008:10:260
19162997921,26cyclictest2603-21seq10:08:282
19162997921,26cyclictest2603-21seq10:08:282
19162997920,20cyclictest23038-21seq12:30:532
19162997918,25cyclictest0-21swapper/208:22:452
19162997917,27cyclictest0-21swapper/207:54:542
19162997916,28cyclictest8708-21wc08:05:582
19158997956,14cyclictest24040-21ssh09:50:561
19158997932,13cyclictest181rcu_preempt10:21:211
19158997931,12cyclictest181rcu_preempt07:46:111
19158997931,12cyclictest181rcu_preempt07:46:111
1914999798,49cyclictest15-21ksoftirqd/009:25:580
19149997960,11cyclictest26549-21diskmemload10:31:290
19162997851,17cyclictest13913-21/usr/sbin/munin11:21:222
19162997813,35cyclictest6687-21latency_hist10:15:582
19162997811,31cyclictest0-21swapper/212:22:112
19158997848,21cyclictest15228-21latency_hist09:35:591
19158997848,21cyclictest15228-21latency_hist09:35:591
19158997827,16cyclictest25345-21ntp_kernel_err07:16:231
19149997810,49cyclictest27945-21apt-get10:51:150
19149997810,49cyclictest27945-21apt-get10:51:150
19162997719,24cyclictest21159-21munin-node09:16:132
19162997715,29cyclictest19079-21sendmail-msp11:30:552
19162997714,25cyclictest0-21swapper/207:17:212
19162997711,34cyclictest1100-21awk09:11:272
19158997744,13cyclictest181rcu_preempt11:50:571
19158997743,13cyclictest181rcu_preempt08:41:091
19158997738,8cyclictest181rcu_preempt12:22:101
1915899773,49cyclictest11455-21kworker/u17:1+xprtiod09:21:251
1914999774,50cyclictest15-21ksoftirqd/008:25:410
19149997744,27cyclictest30966-21cron11:50:550
19162997636,31cyclictest31031-21modprobe07:35:552
19162997619,20cyclictest12299-21seq09:31:002
19162997619,20cyclictest12299-21seq09:31:002
19162997617,25cyclictest19619-21taskset07:01:192
19162997617,24cyclictest1244-21ssh11:55:092
19162997612,28cyclictest0-21swapper/212:00:572
19158997654,15cyclictest22598-21fschecks_count11:36:161
19158997644,10cyclictest181rcu_preempt08:11:131
1914999767,45cyclictest15-21ksoftirqd/010:36:230
19149997653,10cyclictest181rcu_preempt11:52:470
19149997637,29cyclictest161ktimers/009:46:280
1914999763,41cyclictest732-21fw_packets09:11:170
19149997617,33cyclictest15-21ksoftirqd/007:16:110
1916999753,30cyclictest24795-21chrt07:15:583
19162997536,14cyclictest181rcu_preempt10:31:182
19162997520,25cyclictest31439-21ssh10:56:222
19162997520,22cyclictest9526-21find08:06:292
19162997517,27cyclictest16257-21seq08:26:502
19162997517,27cyclictest16257-21seq08:26:502
19162997517,24cyclictest14499-21taskset10:28:202
19162997517,24cyclictest14499-21taskset10:28:202
19162997514,27cyclictest27345-21/usr/sbin/munin07:21:312
19162997513,32cyclictest23526-21fschecks_time07:11:182
19162997513,28cyclictest26549-21diskmemload09:46:112
19162997512,28cyclictest9242-21ssh10:20:192
19162997512,23cyclictest0-21swapper/209:42:232
19158997558,11cyclictest1-21systemd10:50:571
19158997553,13cyclictest19140-21cyclictest10:01:431
19158997550,17cyclictest0-21swapper/108:16:111
19158997548,9cyclictest181rcu_preempt07:51:111
19158997548,10cyclictest181rcu_preempt11:03:531
19158997542,10cyclictest16431-21ssh09:36:341
19158997541,25cyclictest24615-21fschecks_time09:51:181
1915899753,34cyclictest21426-21grep10:40:541
19158997531,17cyclictest181rcu_preempt08:36:181
19158997531,17cyclictest181rcu_preempt08:36:181
1914999758,45cyclictest20577-21ssh12:26:140
19149997555,7cyclictest181rcu_preempt11:14:390
19149997550,10cyclictest181rcu_preempt08:35:530
19149997550,10cyclictest181rcu_preempt08:35:530
19149997539,20cyclictest24911-21df_inode10:46:180
19149997526,17cyclictest15-21ksoftirqd/007:06:520
19149997526,17cyclictest15-21ksoftirqd/007:06:520
1914999752,42cyclictest4394-21grep09:16:320
19162997458,9cyclictest7107-21kworker/u17:1-ext4-rsv-conversion11:15:592
19162997458,9cyclictest7107-21kworker/u17:1-ext4-rsv-conversion11:15:592
19162997446,19cyclictest9643-21fschecks_time09:26:192
19162997419,24cyclictest11563-21seq08:13:342
19162997419,19cyclictest13346-21seq08:20:512
19162997418,20cyclictest6575-21seq12:03:252
19162997416,27cyclictest21241-21seq08:43:312
19162997413,27cyclictest8012-21grep12:06:162
19158997453,14cyclictest19140-21cyclictest08:55:101
19158997453,14cyclictest19140-21cyclictest08:55:101
19158997453,13cyclictest21758-21ssh10:41:101
19158997453,13cyclictest21758-21ssh10:41:101
19158997442,9cyclictest181rcu_preempt11:45:571
19158997442,11cyclictest181rcu_preempt09:59:291
19158997442,11cyclictest181rcu_preempt09:59:291
19158997428,12cyclictest181rcu_preempt11:00:431
19149997460,9cyclictest19140-21cyclictest10:15:540
1914999745,47cyclictest15-21ksoftirqd/011:16:170
1914999745,47cyclictest15-21ksoftirqd/011:16:170
1914999745,46cyclictest15-21ksoftirqd/011:35:580
1914999745,46cyclictest15-21ksoftirqd/011:35:580
19149997452,8cyclictest181rcu_preempt10:57:180
19149997450,16cyclictest12697-21ssh09:31:180
19149997450,16cyclictest12697-21ssh09:31:180
1914999743,39cyclictest15-21ksoftirqd/008:47:150
19149997433,12cyclictest181rcu_preempt09:54:370
19149997433,11cyclictest181rcu_preempt09:28:490
1914999741,35cyclictest15-21ksoftirqd/007:31:060
19149997410,38cyclictest15-21ksoftirqd/007:39:530
1916999732,35cyclictest5587-21taskset12:01:293
19169997323,41cyclictest0-21swapper/311:15:543
1916999732,33cyclictest4581-21chrt12:00:563
19169997318,44cyclictest0-21swapper/307:06:233
19169997318,44cyclictest0-21swapper/307:06:233
19162997349,14cyclictest24610-21diskmemload11:39:472
19162997318,19cyclictest11349-21seq10:22:512
19162997315,23cyclictest0-21swapper/208:36:222
19162997315,23cyclictest0-21swapper/208:36:222
19162997314,25cyclictest7263-21cat09:21:302
19162997313,25cyclictest1-21systemd10:05:552
19162997312,38cyclictest0-21swapper/207:56:322
1915899733,33cyclictest3360-21/usr/sbin/munin09:16:281
19158997327,15cyclictest181rcu_preempt10:30:561
19158997327,15cyclictest181rcu_preempt10:30:561
19158997326,12cyclictest181rcu_preempt09:01:151
19158997326,12cyclictest181rcu_preempt09:01:151
1915899732,42cyclictest16570-21switchtime10:31:301
1914999736,38cyclictest15-21ksoftirqd/007:51:320
19149997353,7cyclictest181rcu_preempt10:07:010
19149997353,7cyclictest181rcu_preempt10:07:010
19149997353,12cyclictest2374-21systemd-journal12:00:540
1914999732,42cyclictest15-21ksoftirqd/011:36:190
19169997239,21cyclictest0-21swapper/310:51:293
19169997239,21cyclictest0-21swapper/310:51:293
19162997217,23cyclictest29362-21seq07:30:332
19162997214,25cyclictest5973-21ssh11:07:472
19162997213,26cyclictest27446-21systemd-run10:50:562
19162997211,27cyclictest0-21swapper/211:46:262
1914999725,32cyclictest15-21ksoftirqd/011:23:400
1914999723,48cyclictest15-21ksoftirqd/007:42:480
1914999723,46cyclictest15-21ksoftirqd/007:56:330
1914999723,42cyclictest15-21ksoftirqd/010:05:580
19149997226,15cyclictest181rcu_preempt08:43:490
1916999713,29cyclictest20243-21taskset08:41:113
19162997115,32cyclictest31812-21fschecks_count07:37:102
19162997111,27cyclictest0-21swapper/212:11:192
19158997148,9cyclictest181rcu_preempt11:34:261
19158997148,9cyclictest181rcu_preempt11:34:261
1915899712,32cyclictest20521-21ssh12:26:131
1914999718,30cyclictest15-21ksoftirqd/010:26:220
1914999718,30cyclictest15-21ksoftirqd/010:26:220
19149997157,9cyclictest23447-21fschecks_count07:11:170
19149997150,8cyclictest181rcu_preempt09:42:220
1914999714,27cyclictest15-21ksoftirqd/008:11:190
1914999712,47cyclictest15-21ksoftirqd/008:30:350
1914999712,47cyclictest15-21ksoftirqd/008:30:350
1914999712,36cyclictest15-21ksoftirqd/008:36:180
1914999712,36cyclictest15-21ksoftirqd/008:36:180
19149997117,37cyclictest15-21ksoftirqd/008:56:320
19149997111,36cyclictest15-21ksoftirqd/011:06:320
19149997111,36cyclictest15-21ksoftirqd/007:47:080
19149997111,36cyclictest15-21ksoftirqd/007:47:080
19169997011,42cyclictest0-21swapper/312:20:353
19169997010,23cyclictest20838-21chrt10:39:193
19162997017,25cyclictest27503-21sh09:01:272
19162997017,25cyclictest27503-21sh09:01:272
19162997012,24cyclictest0-21swapper/208:33:022
19162997012,24cyclictest0-21swapper/208:33:022
19158997046,8cyclictest181rcu_preempt12:15:551
19158997041,11cyclictest181rcu_preempt07:41:171
19149997053,11cyclictest13497-21systemd-run12:15:550
19149997053,11cyclictest11383-21ssh10:22:570
1914999702,35cyclictest15-21ksoftirqd/009:01:290
1914999702,35cyclictest15-21ksoftirqd/009:01:290
1916299695,27cyclictest0-21swapper/211:41:142
19158996937,13cyclictest181rcu_preempt08:56:211
1915899693,35cyclictest4617-21ssh11:06:141
1915899693,30cyclictest23423-21fschecks_count07:11:161
1915899693,17cyclictest6781-21/usr/sbin/munin10:16:291
19158996919,13cyclictest0-21swapper/107:01:111
19158996914,23cyclictest0-21swapper/111:58:481
1914999697,27cyclictest15-21ksoftirqd/012:10:570
1914999696,29cyclictest15-21ksoftirqd/008:20:300
19149996949,7cyclictest181rcu_preempt12:05:510
1916999683,28cyclictest16006-21chrt10:31:173
1916999683,27cyclictest4060-21chrt11:05:493
1916999683,26cyclictest733-21chrt09:11:173
19158996848,14cyclictest297-21systemd-logind08:05:561
1915899683,54cyclictest16384-21ssh11:26:061
1915899683,29cyclictest15071-21latency_hist08:25:581
19158996829,14cyclictest8925-21ssh12:06:391
1915899682,28cyclictest1700-21ssh10:06:311
1915899682,28cyclictest1700-21ssh10:06:311
1914999683,33cyclictest22331-21sh10:41:250
1914999683,33cyclictest22331-21sh10:41:250
19149996831,14cyclictest181rcu_preempt08:55:400
19149996831,14cyclictest181rcu_preempt08:55:400
1916999674,23cyclictest18595-21chrt08:36:133
1916999674,23cyclictest18595-21chrt08:36:133
1916999673,26cyclictest10195-21chrt12:10:123
1916999673,25cyclictest9748-21chrt09:26:213
1916999672,31cyclictest1043-21chrt11:00:433
19162996742,13cyclictest0-21swapper/211:35:582
19162996742,13cyclictest0-21swapper/211:35:582
19162996732,29cyclictest18758-21ssh10:36:072
19158996743,8cyclictest31-21ksoftirqd/109:30:251
19158996735,8cyclictest181rcu_preempt11:51:081
19158996734,24cyclictest58-21kcompactd011:17:391
19158996734,24cyclictest58-21kcompactd011:17:391
1915899672,31cyclictest352-21runrttasks08:30:531
1915899672,31cyclictest352-21runrttasks08:30:531
19149996745,8cyclictest181rcu_preempt11:29:310
1914999672,46cyclictest8492-21cron08:05:550
1916999663,27cyclictest21226-21chrt11:33:373
1916999663,27cyclictest21226-21chrt11:33:373
1916999663,24cyclictest22383-21chrt11:36:093
1916999662,23cyclictest1227-21chrt10:06:213
1916999662,23cyclictest1227-21chrt10:06:213
19169996619,38cyclictest0-21swapper/310:45:113
19169996619,38cyclictest0-21swapper/310:45:113
1915899663,31cyclictest17256-21kernelversion08:31:211
1915899663,31cyclictest17256-21kernelversion08:31:211
1916999653,22cyclictest6131-21chrt11:08:133
1916999653,19cyclictest14047-21chrt10:27:033
1916999653,19cyclictest14047-21chrt10:27:033
1916999652,28cyclictest18417-21chrt11:29:123
1914999656,24cyclictest15-21ksoftirqd/007:30:540
1916999644,23cyclictest17426-21chrt08:31:273
1916999644,23cyclictest17426-21chrt08:31:273
1916999643,27cyclictest18586-21chrt12:22:083
1916999643,26cyclictest12672-21chrt11:19:473
1916999643,26cyclictest12672-21chrt11:19:473
1916999642,25cyclictest26037-21chrt09:53:163
1916999642,21cyclictest30595-21chrt10:01:183
1916999642,21cyclictest15016-21chrt11:23:003
1915899642,42cyclictest20984-21latency_hist09:45:581
1916999637,25cyclictest0-21swapper/307:36:213
1916999634,22cyclictest7506-21chrt09:21:393
1916999633,25cyclictest6197-21chrt10:15:083
1916999633,23cyclictest11347-21chrt12:11:263
1916999633,22cyclictest28340-21chrt11:46:093
1916999632,24cyclictest4485-21chrt07:51:263
1916999632,22cyclictest27801-21chrt09:01:323
1916999632,22cyclictest27801-21chrt09:01:323
1916999632,22cyclictest21916-21chrt08:46:013
1916999632,22cyclictest17503-21chrt09:39:343
1916999632,21cyclictest20921-21chrt09:45:463
1916999629,12cyclictest0-21swapper/312:30:543
1916999623,26cyclictest31794-21chrt09:08:543
1916999623,24cyclictest8777-21taskset08:06:083
1916999623,22cyclictest16266-21chrt08:26:573
1916999623,22cyclictest16266-21chrt08:26:573
1916999623,21cyclictest6981-21chrt10:16:133
1916999623,21cyclictest11224-21chrt10:22:293
1916999623,19cyclictest10568-21chrt08:11:143
1916999622,23cyclictest29232-21chrt07:28:503
1916999622,22cyclictest29364-21chrt09:59:153
1916999622,22cyclictest29364-21chrt09:59:153
1916999622,22cyclictest26274-21chrt08:57:393
1916999622,22cyclictest13625-21chrt08:21:063
1916999622,20cyclictest3793-21chrt09:16:203
1916999622,20cyclictest24866-21chrt07:16:113
1916999613,42cyclictest31376-21chrt07:35:593
1916999613,23cyclictest24824-21chrt10:46:163
1916999613,20cyclictest5565-21chrt07:56:083
1916999613,20cyclictest27954-21chrt11:45:493
1916999613,20cyclictest1150-21chrt07:41:223
1916999612,21cyclictest13008-21chrt08:16:333
1916999603,21cyclictest1073-21chrt11:54:403
1916999602,22cyclictest3354-21chrt07:47:133
1916999602,22cyclictest3354-21chrt07:47:133
1916999602,21cyclictest8338-21chrt08:03:533
1916999602,20cyclictest14890-21chrt09:35:373
1916999602,20cyclictest14890-21chrt09:35:373
1916999599,12cyclictest0-21swapper/309:46:163
1916999593,19cyclictest20470-21chrt07:03:313
1916999592,21cyclictest26472-21chrt07:21:093
1916999562,21cyclictest23587-21taskset08:51:073
1916999562,21cyclictest23587-21taskset08:51:073
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional