You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-09-24 - 06:37
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of all highest latencies:
System rackbslot7.osadl.org (updated Thu Sep 24, 2026 00:44:32)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
17974214411,96sleep118004-21latencyplot19:08:361
17974214411,96sleep118004-21latencyplot19:08:361
1793021076,16sleep20-21swapper/219:07:592
1793021076,16sleep20-21swapper/219:07:592
18129999666,7cyclictest181rcu_preempt23:43:562
18129999666,7cyclictest181rcu_preempt23:43:562
18129999665,11cyclictest181rcu_preempt23:41:022
18123999448,14cyclictest181rcu_preempt21:36:101
18129999166,10cyclictest181rcu_preempt23:29:102
18129999160,11cyclictest181rcu_preempt21:32:372
18129999131,23cyclictest0-21swapper/223:53:572
18129999050,17cyclictest181rcu_preempt22:51:542
18129999050,17cyclictest181rcu_preempt22:51:542
1715229013,41sleep0359-21snmpd19:04:100
1715229013,41sleep0359-21snmpd19:04:100
18129998939,27cyclictest0-21swapper/222:04:442
18123998965,18cyclictest30560-21latency_hist23:58:381
18129998865,8cyclictest181rcu_preempt23:16:022
18129998864,18cyclictest358-21ntpd23:53:382
18129998852,8cyclictest181rcu_preempt23:28:162
18129998733,31cyclictest0-21swapper/222:16:322
18123998757,8cyclictest181rcu_preempt23:13:291
18129998661,17cyclictest17265-21latency_hist21:48:382
18129998630,27cyclictest0-21swapper/200:10:072
18129998556,9cyclictest181rcu_preempt21:23:092
18123998552,8cyclictest181rcu_preempt00:13:371
18123998551,10cyclictest0-21swapper/122:08:581
18119998529,24cyclictest0-21swapper/022:44:020
1728928525,40sleep30-21swapper/319:04:183
1728928525,40sleep30-21swapper/319:04:183
18129998436,22cyclictest0-21swapper/219:08:542
18123998454,12cyclictest181rcu_preempt00:14:121
18123998428,23cyclictest31-21ksoftirqd/100:08:361
18123998343,24cyclictest18110-21cyclictest00:19:471
61312820,12sleep1291rcuc/120:09:011
18123998263,15cyclictest18110-21cyclictest21:09:481
18123998263,15cyclictest18110-21cyclictest21:09:481
18123998262,7cyclictest181rcu_preempt23:40:471
1811999821,37cyclictest20226-21modprobe20:53:350
1811999821,37cyclictest20226-21modprobe20:53:350
18129998153,8cyclictest181rcu_preempt19:48:592
18129998142,13cyclictest0-21swapper/219:23:192
18123998119,32cyclictest31-21ksoftirqd/121:43:581
18123998114,35cyclictest31-21ksoftirqd/121:22:301
18119998122,36cyclictest0-21swapper/021:09:540
18119998122,36cyclictest0-21swapper/021:09:540
18119998116,31cyclictest30101-21apt-get19:43:500
18119998114,26cyclictest0-21swapper/023:24:430
18129998048,11cyclictest181rcu_preempt23:13:352
18129998042,10cyclictest1307-21kworker/u18:2-nfsiod22:40:382
18129998040,12cyclictest181rcu_preempt22:44:252
18123998040,10cyclictest0-21swapper/122:49:111
18123998040,10cyclictest0-21swapper/122:49:111
1812399803,43cyclictest31-21ksoftirqd/123:53:221
18123998018,33cyclictest31-21ksoftirqd/119:08:581
18129997952,8cyclictest181rcu_preempt00:20:022
18129997951,8cyclictest181rcu_preempt22:23:132
18129997946,12cyclictest181rcu_preempt21:07:162
18129997946,12cyclictest181rcu_preempt21:07:162
18129997946,12cyclictest181rcu_preempt21:07:162
18129997944,8cyclictest181rcu_preempt21:41:432
18129997944,8cyclictest181rcu_preempt21:41:432
18129997942,10cyclictest181rcu_preempt21:37:202
18129997935,17cyclictest181rcu_preempt21:24:172
18129997933,21cyclictest0-21swapper/221:49:042
18129997933,21cyclictest0-21swapper/221:49:042
18123997958,10cyclictest0-21swapper/120:20:041
18123997958,10cyclictest0-21swapper/120:20:041
18123997937,9cyclictest2276-21kworker/u17:2-rpciod23:44:091
18123997937,9cyclictest2276-21kworker/u17:2-rpciod23:44:091
18123997917,34cyclictest31-21ksoftirqd/120:03:551
18119997962,11cyclictest25292-21diskmemload00:09:540
1813599783,50cyclictest0-21swapper/300:18:513
1812999786,46cyclictest39-21ksoftirqd/219:53:522
1812999786,46cyclictest39-21ksoftirqd/219:53:522
18129997854,8cyclictest181rcu_preempt20:33:382
18129997848,8cyclictest181rcu_preempt23:33:522
18129997835,26cyclictest0-21swapper/222:23:522
18129997830,23cyclictest0-21swapper/219:29:152
18129997830,23cyclictest0-21swapper/219:29:152
18129997822,18cyclictest0-21swapper/222:35:252
18123997851,9cyclictest181rcu_preempt00:24:321
18123997818,30cyclictest31-21ksoftirqd/123:59:091
18123997816,31cyclictest31-21ksoftirqd/119:13:481
18123997814,29cyclictest301ktimers/122:35:491
18119997819,12cyclictest13333-21cat23:29:010
18129997740,8cyclictest181rcu_preempt20:48:542
18129997740,8cyclictest181rcu_preempt20:48:542
18129997737,8cyclictest0-21swapper/220:59:062
1812999773,48cyclictest28832-21apt-get21:13:542
18129997734,13cyclictest181rcu_preempt00:26:002
1812999772,43cyclictest39-21ksoftirqd/221:09:552
1812999772,43cyclictest39-21ksoftirqd/221:09:552
18129997724,26cyclictest0-21swapper/220:34:072
18129997723,33cyclictest0-21swapper/200:38:252
18129997723,33cyclictest0-21swapper/200:38:252
18123997747,8cyclictest181rcu_preempt23:16:221
18123997727,11cyclictest0-21swapper/122:31:481
18123997727,11cyclictest0-21swapper/122:31:481
18119997755,15cyclictest31735-21latency_hist21:18:380
1811999773,24cyclictest386-21ssh23:08:370
1811999773,24cyclictest386-21ssh23:08:370
18129997642,11cyclictest181rcu_preempt22:59:142
18129997642,11cyclictest181rcu_preempt00:14:542
18123997655,7cyclictest181rcu_preempt21:59:071
18123997650,7cyclictest181rcu_preempt21:23:401
18123997648,8cyclictest181rcu_preempt19:38:471
18123997645,7cyclictest181rcu_preempt22:21:011
18123997643,14cyclictest9100-21ssh23:22:191
18123997643,14cyclictest9100-21ssh23:22:191
18123997642,8cyclictest181rcu_preempt23:29:301
18123997639,9cyclictest181rcu_preempt22:41:291
18123997639,11cyclictest16328-21memory23:34:031
18123997638,7cyclictest181rcu_preempt21:53:501
18119997661,8cyclictest0-21swapper/000:33:350
1811999761,22cyclictest23388-21sed21:58:390
18129997555,8cyclictest181rcu_preempt21:57:152
18129997554,14cyclictest4433-21cat00:08:392
18129997551,8cyclictest181rcu_preempt19:48:392
18129997543,8cyclictest181rcu_preempt22:09:092
18129997543,11cyclictest181rcu_preempt20:53:472
18129997540,12cyclictest181rcu_preempt22:57:382
18129997530,11cyclictest0-21swapper/220:39:032
18129997524,19cyclictest0-21swapper/200:29:132
18123997559,7cyclictest0-21swapper/121:05:181
18123997559,7cyclictest0-21swapper/121:05:181
18123997559,7cyclictest0-21swapper/121:05:181
18123997558,12cyclictest200-21systemd-journal21:15:071
18123997539,10cyclictest181rcu_preempt23:03:431
18123997539,10cyclictest181rcu_preempt23:03:431
18123997536,8cyclictest181rcu_preempt22:48:371
1812399753,30cyclictest31-21ksoftirqd/119:55:341
1812399753,30cyclictest31-21ksoftirqd/119:55:341
18123997531,8cyclictest0-21swapper/120:49:121
18123997531,8cyclictest0-21swapper/120:49:121
18123997521,21cyclictest31-21ksoftirqd/119:44:071
18119997533,32cyclictest0-21swapper/000:33:580
18119997533,32cyclictest0-21swapper/000:33:580
1813599747,54cyclictest4657-21taskset00:09:103
18135997441,22cyclictest20759-21chrt19:14:033
18129997451,11cyclictest181rcu_preempt19:39:112
18129997451,10cyclictest181rcu_preempt20:46:472
18129997451,10cyclictest181rcu_preempt20:46:472
18129997430,20cyclictest0-21swapper/220:13:532
18129997428,7cyclictest181rcu_preempt22:01:132
18129997426,25cyclictest0-21swapper/220:20:042
18129997426,25cyclictest0-21swapper/220:20:042
18123997447,19cyclictest28186-21modprobe19:38:351
18123997444,21cyclictest12998-21wc20:29:101
1812399744,32cyclictest31-21ksoftirqd/120:14:131
18123997442,8cyclictest181rcu_preempt19:27:251
1812399743,25cyclictest17370-21/usr/sbin/munin00:29:081
18123997419,30cyclictest31-21ksoftirqd/122:59:121
18123997417,32cyclictest31-21ksoftirqd/120:28:361
18123997415,32cyclictest31-21ksoftirqd/121:28:571
18123997413,32cyclictest3403-21unixbench_multi19:59:141
18123997412,29cyclictest31-21ksoftirqd/119:49:111
1811999744,28cyclictest0-21swapper/021:23:470
1811999744,24cyclictest0-21swapper/023:41:190
18119997424,9cyclictest0-21swapper/019:58:520
18119997420,17cyclictest26183-21modprobe22:03:350
18119997418,14cyclictest26669-21df_inode22:03:550
1813599734,40cyclictest19371-21chrt00:33:353
1813599734,35cyclictest32181-21chrt21:18:593
18129997342,9cyclictest181rcu_preempt19:59:022
18129997335,10cyclictest0-21swapper/222:31:062
18129997335,10cyclictest0-21swapper/222:31:062
18129997330,10cyclictest0-21swapper/219:18:302
18129997325,28cyclictest0-21swapper/219:33:542
18129997324,17cyclictest0-21swapper/223:08:382
18129997324,17cyclictest0-21swapper/223:08:382
18129997322,31cyclictest0-21swapper/220:04:192
18123997325,14cyclictest181rcu_preempt00:35:101
18123997325,14cyclictest181rcu_preempt00:35:101
18123997318,30cyclictest31-21ksoftirqd/120:53:531
18123997312,29cyclictest31-21ksoftirqd/119:29:061
18123997312,29cyclictest31-21ksoftirqd/119:29:061
1811999737,25cyclictest18876-21/usr/sbin/munin19:09:080
18119997356,10cyclictest27034-21fschecks_count19:33:570
18119997352,15cyclictest24009-21latency_hist22:53:390
18129997243,9cyclictest181rcu_preempt20:24:102
18129997236,9cyclictest181rcu_preempt00:00:192
1812999723,36cyclictest6934-21apt-get23:18:452
1812999723,36cyclictest6934-21apt-get23:18:452
18123997241,9cyclictest181rcu_preempt22:05:551
18123997237,8cyclictest181rcu_preempt22:57:191
18123997231,11cyclictest18110-21cyclictest21:41:501
18123997231,11cyclictest18110-21cyclictest21:41:501
18123997228,12cyclictest0-21swapper/120:58:441
1811999725,38cyclictest27199-21cpuspeed22:58:520
18119997218,15cyclictest24974-21modprobe19:28:360
18119997210,27cyclictest0-21swapper/022:34:090
1813599713,35cyclictest4173-21chrt00:08:383
18129997137,12cyclictest181rcu_preempt19:24:122
18123997141,9cyclictest181rcu_preempt21:53:381
18123997141,9cyclictest181rcu_preempt21:53:381
18123997136,8cyclictest181rcu_preempt22:24:481
18123997118,19cyclictest31-21ksoftirqd/120:34:091
18123997113,28cyclictest31-21ksoftirqd/120:43:391
1811999715,30cyclictest595-21/usr/sbin/munin22:14:050
18119997149,14cyclictest536-21ssh21:19:160
18119997132,33cyclictest161ktimers/000:27:240
18119997117,19cyclictest24110-21ssh22:53:490
1811999711,29cyclictest4066-21apt-key00:08:360
18119997110,22cyclictest0-21swapper/022:19:120
18123997055,8cyclictest301ktimers/119:19:111
18123997052,12cyclictest326-21systemd-logind20:48:361
18123997052,12cyclictest326-21systemd-logind20:48:361
18123997043,7cyclictest181rcu_preempt22:15:071
18123997034,7cyclictest181rcu_preempt23:26:251
1811999709,27cyclictest21807-21cron20:58:350
18119997053,12cyclictest6959-21timerandwakeup22:24:110
18119997042,21cyclictest18848-21kworker/u17:1+nfsiod21:53:290
18119997042,21cyclictest18848-21kworker/u17:1+nfsiod21:53:290
18119997022,9cyclictest11105-21cron21:38:350
18119997017,23cyclictest317-21dbus-daemon21:48:360
1813599693,35cyclictest14892-21chrt23:31:553
1813599692,54cyclictest0-21swapper/323:18:433
1813599692,54cyclictest0-21swapper/323:18:433
18129996938,9cyclictest181rcu_preempt20:09:452
1811999698,25cyclictest30724-21ssh22:09:370
1811999696,25cyclictest22034-21/usr/sbin/munin23:43:560
1811999696,25cyclictest22034-21/usr/sbin/munin23:43:560
1811999696,25cyclictest17243-21/usr/sbin/munin20:44:120
1811999696,25cyclictest17243-21/usr/sbin/munin20:44:120
1811999695,28cyclictest25292-21diskmemload23:19:060
1811999695,28cyclictest25292-21diskmemload23:19:060
18119996951,13cyclictest5709-21acpi20:08:450
18119996949,13cyclictest317-21dbus-daemon00:18:370
18119996946,14cyclictest3655-21sh23:13:450
18119996920,13cyclictest17356-21rm22:42:290
18119996919,12cyclictest9801-21ntpq20:20:100
18119996919,12cyclictest9801-21ntpq20:20:100
18119996918,21cyclictest0-21swapper/020:29:130
18119996916,22cyclictest0-21swapper/023:53:540
1811999691,37cyclictest23605-21latency_hist21:03:380
18119996850,12cyclictest25580-21sh23:49:110
1811999683,37cyclictest24239-21tune2fs21:05:040
1811999683,37cyclictest24239-21tune2fs21:05:040
1811999683,37cyclictest24239-21tune2fs21:05:040
18119996819,13cyclictest21524-21sh22:49:050
18119996818,12cyclictest4294-21grep20:04:010
18119996817,18cyclictest16223-21runrttasks23:34:010
1813599673,33cyclictest2297-21chrt19:58:383
1813599673,33cyclictest2297-21chrt19:58:383
1813599673,33cyclictest17386-21chrt22:42:343
1813599673,27cyclictest27198-21taskset19:34:003
1811999679,25cyclictest5635-21sh21:28:580
1811999674,32cyclictest14358-21/usr/sbin/munin20:33:570
1811999674,27cyclictest15636-21/usr/sbin/munin20:39:030
1811999673,29cyclictest20252-21grep19:13:480
18119996722,9cyclictest114132sleep022:32:420
18119996722,9cyclictest114132sleep022:32:420
18119996719,11cyclictest0-21swapper/021:39:040
18119996719,11cyclictest0-21swapper/021:39:040
18119996717,18cyclictest7454-21expr20:13:540
18119996717,13cyclictest2056-21chrt19:56:490
18119996717,13cyclictest2056-21chrt19:56:490
18119996717,11cyclictest10912-21cstates20:23:520
18119996711,27cyclictest13002-21ssh00:22:280
1813599663,27cyclictest4669-21chrt21:27:223
1813599663,22cyclictest28697-21chrt22:07:193
1813599662,25cyclictest8969-21chrt21:34:033
1811999664,27cyclictest22824-21chrt19:19:110
18119996630,29cyclictest25254-21apt-get19:28:490
18119996630,29cyclictest25254-21apt-get19:28:490
1813599653,25cyclictest18030-21taskset21:49:073
1813599653,25cyclictest18030-21taskset21:49:073
1813599653,22cyclictest7468-21chrt00:13:453
1813599653,21cyclictest29021-21chrt19:39:063
1811999659,25cyclictest32236-21sh00:00:140
18119996546,13cyclictest18110-21cyclictest23:09:110
1811999654,29cyclictest28503-21/usr/sbin/munin19:38:530
18119996519,11cyclictest0-21swapper/019:48:580
1813599649,23cyclictest9212-21chrt20:18:513
1813599649,23cyclictest9212-21chrt20:18:513
1813599643,28cyclictest15893-21chrt00:27:153
1813599643,28cyclictest14173-21chrt22:37:033
1813599643,27cyclictest20491-21chrt20:53:523
1813599643,25cyclictest13469-21chrt21:41:453
1813599643,25cyclictest13469-21chrt21:41:453
1813599642,27cyclictest8248-21chrt20:14:133
1813599633,9cyclictest301512chrt23:03:503
1813599633,9cyclictest301512chrt23:03:503
1813599633,25cyclictest32183-21chrt22:13:363
1813599633,24cyclictest28308-21chrt21:13:363
1813599633,24cyclictest28308-21chrt21:13:363
1813599633,23cyclictest25747-21chrt19:29:063
1813599633,23cyclictest25747-21chrt19:29:063
1813599633,23cyclictest21818-21chrt23:43:503
1813599633,23cyclictest21818-21chrt23:43:503
1813599632,26cyclictest26247-21chrt22:57:093
1813599632,26cyclictest19067-21chrt23:39:003
1813599632,24cyclictest11478-21chrt23:25:383
1813599632,22cyclictest6872-21chrt21:30:103
1813599632,20cyclictest3878-21chrt20:03:363
18135996310,39cyclictest24019-21chrt21:04:493
18135996310,39cyclictest24019-21chrt21:04:493
18135996310,39cyclictest24019-21chrt21:04:493
1813599624,26cyclictest15643-21chrt20:38:453
1813599623,22cyclictest24696-21chrt21:59:333
1813599623,21cyclictest24975-21chrt23:48:563
1813599622,25cyclictest14164-21chrt20:33:513
1813599622,24cyclictest29544-21chrt23:56:103
1813599622,23cyclictest4276-21chrt22:19:323
1813599622,22cyclictest20317-21chrt22:47:203
1813599622,21cyclictest5870-21chrt20:08:553
1813599622,21cyclictest2173-21chrt23:10:193
1813599622,21cyclictest17916-21chrt23:37:053
1813599619,44cyclictest0-21swapper/321:03:393
1813599618,45cyclictest0-21swapper/319:48:383
1813599618,44cyclictest0-21swapper/321:53:563
1813599613,24cyclictest7219-21chrt22:24:223
1813599612,27cyclictest6245-21taskset23:18:173
1813599612,24cyclictest29610-21taskset23:03:053
1813599612,24cyclictest19856-21chrt20:49:143
1813599612,24cyclictest19856-21chrt20:49:143
1813599612,23cyclictest22256-21taskset19:18:573
1813599612,23cyclictest13413-21chrt20:29:183
1813599612,23cyclictest11012-21chrt22:31:353
1813599612,23cyclictest11012-21chrt22:31:353
1813599612,21cyclictest4122-21chrt20:03:523
1813599612,21cyclictest20853-21chrt00:34:243
1813599612,21cyclictest20853-21chrt00:34:243
18135996110,41cyclictest0-21swapper/321:13:543
1813599609,40cyclictest0-21swapper/323:58:593
1813599603,21cyclictest18518-21chrt20:47:363
1813599603,21cyclictest18518-21chrt20:47:363
1813599603,21cyclictest15680-21chrt21:44:333
1813599602,21cyclictest2701-21chrt22:18:343
1813599602,21cyclictest19326-21chrt19:09:343
1813599602,20cyclictest24863-21chrt19:27:123
1813599599,40cyclictest0-21swapper/320:23:573
1813599592,20cyclictest341-21chrt19:50:403
18135995911,39cyclictest0-21swapper/322:49:043
18135995911,39cyclictest0-21swapper/322:49:043
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional