You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-05-06 - 20:21
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the 792 highest latencies:
System rackbslot7.osadl.org (updated Wed May 06, 2026 12:44:30)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
2673821439,99sleep126829-21timerwakeupswit06:57:291
2673821439,99sleep126829-21timerwakeupswit06:57:291
274119911961,51cyclictest0-21swapper/012:02:100
27411991053,27cyclictest0-21swapper/009:01:560
2592721057,71sleep30-21swapper/306:56:543
2592721057,71sleep30-21swapper/306:56:543
27411991047,17cyclictest27412-21latency_hist07:01:470
27411991047,17cyclictest27412-21latency_hist07:01:470
274209910359,32cyclictest0-21swapper/209:37:172
274119910327,9cyclictest15350irq/295-2188000.ethernet08:46:540
274119910327,9cyclictest15350irq/295-2188000.ethernet08:46:540
274119910247,48cyclictest27402-21cyclictest08:16:470
274119910247,48cyclictest27402-21cyclictest08:16:470
27411991022,41cyclictest17001-21taskset12:07:320
274119910148,45cyclictest0-21swapper/009:12:150
274209910056,37cyclictest11753-21ntp_kernel_pll_09:17:112
274209910056,37cyclictest11753-21ntp_kernel_pll_09:17:112
27411991003,25cyclictest32523-21/usr/sbin/munin09:52:060
27411991003,25cyclictest32523-21/usr/sbin/munin09:52:060
27411991003,22cyclictest30505-21sh11:36:530
27411991002,37cyclictest1001-21apt-get11:41:530
27411991002,37cyclictest1001-21apt-get11:41:530
27420999974,9cyclictest181rcu_preempt11:42:012
27420999974,9cyclictest181rcu_preempt11:42:012
27411999941,49cyclictest0-21swapper/012:26:440
27411999941,49cyclictest0-21swapper/012:26:440
2741199992,41cyclictest464-21cat10:46:590
27411999847,45cyclictest0-21swapper/008:46:460
2741199982,26cyclictest15855-21fschecks_time11:12:040
2741199982,26cyclictest15855-21fschecks_time11:12:040
27420999752,38cyclictest0-21swapper/212:07:172
27411999751,21cyclictest181rcu_preempt10:37:120
2741199973,41cyclictest3656-21taskset10:51:590
27411999732,58cyclictest0-21swapper/012:27:190
2741199973,21cyclictest1923-21latency_hist09:01:450
27411999647,43cyclictest1865-21diskmemload09:21:540
27411999639,52cyclictest0-21swapper/011:36:430
2741199962,23cyclictest352-21runrttasks12:18:430
2741199954,25cyclictest24872-21/usr/sbin/munin08:32:080
2741199953,22cyclictest10146-21fschecks_count11:57:040
2741199952,31cyclictest9765-21latency_hist11:56:450
27411999519,7cyclictest0-21swapper/010:02:040
104782950,6sleep00-21swapper/010:09:190
27415999469,16cyclictest19676-21snmpd10:37:201
2741199943,39cyclictest23102-21/usr/sbin/munin09:37:170
27411999428,59cyclictest0-21swapper/011:02:090
2741199942,38cyclictest20853-21apt-get10:26:540
2741199942,28cyclictest20115-21apt-get08:17:450
2741199942,28cyclictest20115-21apt-get08:17:450
2741199942,21cyclictest12502-21switchtime10:12:180
27415999351,34cyclictest0-21swapper/107:21:471
2741199933,33cyclictest32184-21timerwakeupswit08:52:180
2741199933,25cyclictest31846-21sendmail09:51:430
2741199932,39cyclictest17369-21fschecks_count09:27:040
27415999245,40cyclictest0-21swapper/112:21:421
27411999245,41cyclictest0-21swapper/010:32:200
2741199924,26cyclictest32743-21cat07:16:460
27411999235,51cyclictest15180-21sshd09:10:150
27411999235,51cyclictest15180-21sshd09:10:150
2741199923,28cyclictest26698-21/usr/sbin/munin09:42:110
2741199922,23cyclictest352-21runrttasks11:50:020
27411999221,7cyclictest0-21swapper/012:16:000
27411999214,33cyclictest20332-21diskstats09:32:030
27411999214,23cyclictest8199-21sh10:58:430
27411999212,27cyclictest19144-21ntp_kernel_pll_11:17:100
27415999147,7cyclictest181rcu_preempt12:30:511
2741199914,25cyclictest2691-21apt-get09:56:530
2741199912,22cyclictest27447-21latency_hist11:31:470
27411999118,22cyclictest11732-21apt-get07:51:540
27420999043,40cyclictest0-21swapper/208:42:192
2741199903,36cyclictest11355-21df09:17:010
2741199903,36cyclictest11355-21df09:17:010
2741199903,26cyclictest11627-21grep07:51:460
2741199903,25cyclictest22340-21ssh11:22:170
27411999023,7cyclictest0-21swapper/007:41:430
2741199902,23cyclictest5967-21/usr/sbin/munin07:32:170
27411999017,6cyclictest0-21swapper/008:02:140
27411999017,6cyclictest0-21swapper/008:02:140
2683229011,52sleep226911-21unixbench_singl06:57:302
2683229011,52sleep226911-21unixbench_singl06:57:302
27420998948,33cyclictest0-21swapper/212:21:462
27420998946,35cyclictest27939-21interrupts11:32:072
27415998928,55cyclictest0-21swapper/110:27:171
2741199894,29cyclictest20533-21latency_hist10:26:460
2741199893,22cyclictest16806-21cut08:07:050
27411998931,53cyclictest0-21swapper/010:21:450
27411998931,53cyclictest0-21swapper/010:21:450
2741199892,27cyclictest8947-21/usr/sbin/munin07:42:100
27411998921,7cyclictest0-21swapper/011:07:130
27420998850,32cyclictest0-21swapper/207:26:462
27420998842,40cyclictest1358-21timerwakeupswit10:47:192
27420998841,41cyclictest0-21swapper/209:12:192
2741599884,29cyclictest27022-21ssh12:25:101
2741599884,29cyclictest27022-21ssh12:25:101
2741599883,32cyclictest23666-21rm11:25:121
2741199883,22cyclictest13637-21idleruntime07:57:050
2741199883,22cyclictest13637-21idleruntime07:57:050
2741199882,26cyclictest1781-21awk07:21:430
2741199882,23cyclictest3895-21grep07:27:040
2741199882,23cyclictest3895-21grep07:27:040
2741199882,23cyclictest29814-21fschecks_count07:07:070
27420998763,17cyclictest16408-21latency_hist08:06:452
27420998763,17cyclictest16408-21latency_hist08:06:452
27420998746,34cyclictest26963-21ssh09:42:172
27420998743,39cyclictest23867-21kworker/u17:1-xprtiod09:02:052
27420998742,38cyclictest1865-21diskmemload11:19:422
27420998739,42cyclictest0-21swapper/211:56:582
2742099873,34cyclictest32185-21timerwakeupswit08:52:182
27420998732,47cyclictest0-21swapper/208:07:002
27415998766,15cyclictest690-21fschecks_count08:57:041
27415998765,13cyclictest0-21swapper/109:07:041
27415998765,13cyclictest0-21swapper/109:07:041
27415998764,14cyclictest2374-21systemd-journal12:10:241
27411998729,53cyclictest0-21swapper/010:42:190
27411998729,53cyclictest0-21swapper/010:42:190
2741199872,23cyclictest2040-21apt-get07:21:590
2741199872,20cyclictest27856-21idleruntime-cro08:41:430
27420998663,16cyclictest544-21cron12:26:432
27420998663,16cyclictest544-21cron12:26:432
27420998645,34cyclictest0-21swapper/210:57:222
27420998641,38cyclictest1865-21diskmemload10:23:172
27420998638,43cyclictest0-21swapper/211:02:192
27415998647,32cyclictest0-21swapper/108:46:441
27415998636,44cyclictest0-21swapper/111:32:041
27415998636,43cyclictest0-21swapper/109:17:021
27415998636,43cyclictest0-21swapper/109:17:021
27415998635,45cyclictest18284-21sort08:12:001
27415998635,45cyclictest18284-21sort08:12:001
27415998632,47cyclictest17255-21grep08:07:171
2741199862,22cyclictest22228-21ntpq08:23:220
2742099854,71cyclictest18997-21timerandwakeup08:12:182
2742099854,71cyclictest18997-21timerandwakeup08:12:182
2742099853,26cyclictest11820-21/usr/sbin/munin07:52:002
27415998544,33cyclictest3781-21unixbench_singl09:57:201
27415998526,53cyclictest0-21swapper/111:57:041
27415998525,8cyclictest0-21swapper/111:18:251
27411998529,50cyclictest0-21swapper/008:27:110
2741199852,24cyclictest27949-21/usr/sbin/munin07:02:080
2742099846,13cyclictest0-21swapper/211:16:412
2742099846,13cyclictest0-21swapper/211:16:412
27420998443,31cyclictest0-21swapper/210:11:462
2742099843,28cyclictest7469-21/usr/sbin/munin11:52:102
27420998431,44cyclictest0-21swapper/212:27:162
2742099842,71cyclictest8601-21sed10:06:472
2742099842,19cyclictest9174-21/usr/sbin/munin07:42:162
27415998444,33cyclictest0-21swapper/111:02:161
2741599844,26cyclictest87-21kswapd007:01:551
27415998438,24cyclictest0-21swapper/110:07:051
27415998430,47cyclictest0-21swapper/111:13:061
27415998430,47cyclictest0-21swapper/111:13:061
27415998417,23cyclictest12199-21sh10:12:091
2742099837,11cyclictest0-21swapper/209:31:462
27420998348,30cyclictest27402-21cyclictest09:10:202
27420998348,30cyclictest27402-21cyclictest09:10:202
27420998336,39cyclictest0-21swapper/211:27:062
2741599833,28cyclictest11713-21/usr/sbin/munin07:52:001
27415998326,51cyclictest0-21swapper/111:42:151
27415998326,51cyclictest0-21swapper/111:42:151
27420998242,34cyclictest0-21swapper/207:21:472
27420998241,33cyclictest0-21swapper/208:27:072
27420998240,36cyclictest13105-21fschecks_count12:02:042
27420998240,35cyclictest0-21swapper/207:47:062
2742099823,19cyclictest20853-21apt-get10:26:592
27415998223,12cyclictest0-21swapper/109:27:201
27415998222,8cyclictest0-21swapper/110:48:191
27415998222,23cyclictest5873-21diskstats10:02:031
27415998215,26cyclictest1-21systemd08:26:441
27420998151,22cyclictest4977-21modprobe07:31:432
27420998151,22cyclictest4977-21modprobe07:31:432
27420998137,37cyclictest5168-21diskmemload10:01:122
2742099813,30cyclictest5786-21/usr/sbin/munin07:32:112
2742099813,26cyclictest23036-21latency_hist09:36:462
2742099813,21cyclictest17500-21latency_hist10:21:462
2742099813,21cyclictest17500-21latency_hist10:21:462
27420998124,46cyclictest0-21swapper/208:37:032
27415998158,14cyclictest14217-21kworker/u17:3-rpciod11:37:511
2741599813,34cyclictest17868-21apt-get10:22:071
27415998132,41cyclictest0-21swapper/111:52:101
2741599813,22cyclictest17501-21latency_hist10:21:461
2741599813,22cyclictest17501-21latency_hist10:21:461
27415998125,7cyclictest0-21swapper/108:36:451
27415998123,14cyclictest2938-21grep07:22:201
27415998118,24cyclictest277-21dbus-daemon12:16:431
27415998117,21cyclictest30641-21seq07:07:301
27415998114,22cyclictest14504-21sort09:22:061
27420998041,32cyclictest20129-21diskmemload12:12:532
27420998037,36cyclictest5239-21diskmemload11:47:492
2742099803,33cyclictest13637-21ssh10:14:452
2742099803,26cyclictest20269-21/usr/sbin/munin08:17:542
2742099803,26cyclictest20269-21/usr/sbin/munin08:17:542
2742099803,24cyclictest13503-21/usr/sbin/munin07:57:032
2742099803,24cyclictest13503-21/usr/sbin/munin07:57:032
2742099803,22cyclictest24879-21acpi08:31:532
27420998029,43cyclictest0-21swapper/210:52:242
27420998019,8cyclictest0-21swapper/211:24:152
2741599805,23cyclictest32133-21/usr/sbin/munin09:52:101
2741599805,23cyclictest32133-21/usr/sbin/munin09:52:101
2741599803,24cyclictest4326-21sed10:52:311
2741599803,21cyclictest20583-21grep09:32:081
27415998029,44cyclictest0-21swapper/109:51:451
27415998019,9cyclictest0-21swapper/111:27:151
2742099793,31cyclictest14908-21mailstats09:22:172
27420997932,40cyclictest0-21swapper/207:02:012
27415997963,9cyclictest0-21swapper/110:42:171
27415997963,9cyclictest0-21swapper/110:42:171
2741599794,24cyclictest5533-21fschecks_time07:32:051
27415997931,41cyclictest0-21swapper/109:12:061
27415997918,22cyclictest26832-21tr09:42:151
2742099783,27cyclictest15248-21latency_hist11:11:462
2742099783,25cyclictest30489-21/usr/sbin/munin10:42:142
2742099783,25cyclictest30489-21/usr/sbin/munin10:42:142
2742099783,25cyclictest1402-21unixbench_multi08:57:192
2742099783,24cyclictest31478-21/usr/sbin/munin07:12:052
2742099783,23cyclictest31117-21/usr/sbin/munin11:37:122
2742099783,21cyclictest23861-21apt-get10:31:552
27420997827,43cyclictest0-21swapper/207:07:112
27415997857,11cyclictest0-21swapper/108:52:081
2741599784,26cyclictest13615-21/usr/sbin/munin12:02:161
2741599783,24cyclictest2357-21rm09:02:011
2741599783,22cyclictest3986-21ssh11:46:561
27415997828,43cyclictest0-21swapper/108:31:461
27415997827,43cyclictest0-21swapper/107:43:391
27415997825,7cyclictest0-21swapper/110:33:451
2741599782,28cyclictest9309-21ssh11:01:441
2741599782,26cyclictest6923-21cpu07:36:591
27415997815,22cyclictest13990-21diskmemload11:08:141
2742099774,24cyclictest7358-21/usr/sbin/munin07:37:102
2742099772,28cyclictest30309-21sh09:47:392
27415997728,42cyclictest0-21swapper/107:14:191
2741599772,26cyclictest31065-21/usr/sbin/munin08:51:451
2741599772,26cyclictest31065-21/usr/sbin/munin08:51:451
2741599772,24cyclictest20040-21apt-get08:17:161
2741599772,24cyclictest20040-21apt-get08:17:161
2742899763,64cyclictest17969-21chrt10:22:113
2742099763,26cyclictest27865-21awk10:37:202
27420997631,38cyclictest0-21swapper/208:47:002
27420997631,38cyclictest0-21swapper/208:47:002
27420997630,40cyclictest0-21swapper/209:52:162
27420997630,40cyclictest0-21swapper/209:52:162
2741599763,22cyclictest28039-21latency_hist08:41:471
2741599763,22cyclictest23911-21/usr/sbin/munin09:37:181
2741599763,22cyclictest10351-21grep07:47:051
2741599762,22cyclictest16518-21latency_hist08:06:461
2741599753,22cyclictest14932-21/usr/sbin/munin08:02:171
2742099744,11cyclictest0-21swapper/208:24:042
2741599742,21cyclictest13719-21runrttasks07:57:071
2741599742,21cyclictest13719-21runrttasks07:57:071
27415997316,19cyclictest4337-21switchtime07:27:171
27415997316,19cyclictest4337-21switchtime07:27:171
2742899708,53cyclictest19098-21chrt12:12:013
2742899703,44cyclictest32720-21chrt10:46:473
2742899703,44cyclictest32720-21chrt10:46:473
2742899634,44cyclictest5023-21taskset07:31:433
2742899634,44cyclictest5023-21taskset07:31:433
2742899623,44cyclictest25960-21taskset12:22:183
2742899623,44cyclictest25960-21taskset12:22:183
2742899623,40cyclictest31244-21chrt08:51:463
2742899623,40cyclictest31244-21chrt08:51:463
2742899605,37cyclictest0-21swapper/310:52:023
2742899597,39cyclictest2022-21chrt11:42:193
2742899597,39cyclictest2022-21chrt11:42:193
2742899582,39cyclictest693-21chrt08:57:043
2742899574,33cyclictest851-21taskset11:41:463
2742899573,37cyclictest639-21chrt07:17:053
2742899573,37cyclictest31081-21taskset09:49:493
2742899563,45cyclictest11907-21taskset11:59:533
2742899563,41cyclictest12512-21taskset10:12:183
2742899563,39cyclictest32416-21chrt09:52:043
2742899563,39cyclictest32416-21chrt09:52:043
2742899563,36cyclictest16479-21chrt08:06:463
2742899563,36cyclictest16479-21chrt08:06:463
2742899554,37cyclictest971-21chrt10:47:113
2742899554,36cyclictest18178-21chrt09:27:203
2742899553,42cyclictest10076-21taskset10:08:133
2742899553,40cyclictest29810-21chrt12:29:403
2742899553,39cyclictest24877-21taskset08:31:533
2742899553,37cyclictest23564-21chrt09:37:093
2742899544,33cyclictest26058-21chrt11:28:333
2742899543,41cyclictest18606-21chrt08:12:093
2742899543,41cyclictest18606-21chrt08:12:093
2742899543,36cyclictest9911-21taskset07:46:453
2742899535,32cyclictest20709-21chrt09:32:103
2742899534,33cyclictest10098-21chrt07:46:543
2742899533,37cyclictest22702-21taskset08:23:313
2742899533,37cyclictest10130-21chrt11:02:113
2742899532,43cyclictest28992-21taskset11:33:193
2742899525,36cyclictest0-21swapper/308:17:133
2742899525,36cyclictest0-21swapper/308:17:133
2742899524,34cyclictest16472-21taskset12:07:153
2742899523,39cyclictest17969-21taskset08:11:443
2742899523,36cyclictest2897-21chrt07:22:193
2742899523,35cyclictest15722-21taskset11:11:593
2742899523,35cyclictest15722-21taskset11:11:593
2742899523,33cyclictest5322-21chrt07:31:593
2742899523,33cyclictest15712-21chrt12:06:463
2742899522,37cyclictest28101-21chrt08:41:543
2742899522,34cyclictest8604-21chrt10:06:473
2742899514,35cyclictest9872-21taskset09:13:583
2742899514,35cyclictest13396-21chrt09:20:313
2742899514,35cyclictest13396-21chrt09:20:313
2742899513,36cyclictest23829-21taskset10:31:513
2742899513,35cyclictest24220-21chrt11:26:423
2742899513,35cyclictest16791-21chrt10:20:163
2742899513,35cyclictest16791-21chrt10:20:163
2742899513,34cyclictest29640-21chrt07:06:563
2742899503,36cyclictest6850-21taskset10:57:043
2742899503,33cyclictest24131-21chrt08:27:203
2742899502,36cyclictest31824-21taskset07:12:153
2742899502,35cyclictest21175-21taskset10:27:053
2742899502,34cyclictest6542-21chrt09:08:073
2742899502,34cyclictest6542-21chrt09:08:073
2742899493,34cyclictest26625-21chrt08:37:003
2742899493,34cyclictest19226-21taskset11:17:143
2742899493,32cyclictest13146-21chrt07:56:463
2742899492,34cyclictest4462-21chrt09:59:133
2742899492,33cyclictest16841-21chrt09:26:433
2742899483,32cyclictest2711-21taskset09:02:113
2742899483,31cyclictest26324-21chrt09:42:033
2742899482,33cyclictest31660-21chrt08:52:063
2742899465,32cyclictest24225-21chrt12:20:363
2742899452,30cyclictest13994-21chrt11:08:153
2742899443,27cyclictest28964-21chrt10:40:103
2742899442,31cyclictest14634-21chrt08:01:153
2742899442,31cyclictest14634-21chrt08:01:153
2742899434,28cyclictest7652-21chrt07:37:183
27428994315,20cyclictest0-21swapper/311:46:463
2742899422,28cyclictest9054-21taskset11:55:113
2742899383,25cyclictest28914-21chrt07:06:323
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional