You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-06-22 - 21:35
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of all highest latencies:
System rackbslot7.osadl.org (updated Mon Jun 22, 2026 12:44:29)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
23843216412,102sleep023537-21/usr/sbin/munin06:54:010
250469911327,27cyclictest0-21swapper/008:03:440
25062991044,45cyclictest3565-21/usr/sbin/munin09:58:572
250629910388,11cyclictest58-21kcompactd010:48:482
250629910237,13cyclictest0-21swapper/207:33:582
250629910237,13cyclictest0-21swapper/207:33:582
250579910142,52cyclictest0-21swapper/112:03:451
25046991015,54cyclictest29998-21apt-get09:48:550
25046991015,54cyclictest29998-21apt-get09:48:550
250629910050,43cyclictest0-21swapper/210:04:082
2506299993,43cyclictest27260-21apt-get10:38:482
25062999923,27cyclictest8429-21diskmemload11:53:562
25057999937,8cyclictest0-21swapper/109:09:011
25057999738,8cyclictest0-21swapper/111:34:101
25057999734,7cyclictest0-21swapper/109:34:091
25057999734,7cyclictest0-21swapper/109:34:091
2506299964,34cyclictest352-21runrttasks09:45:232
2506299964,34cyclictest352-21runrttasks09:45:232
25057999640,10cyclictest0-21swapper/107:43:451
25046999611,51cyclictest0-21swapper/011:33:550
25057999535,10cyclictest0-21swapper/107:58:511
25057999534,8cyclictest0-21swapper/108:34:061
2505799953,45cyclictest12742-21cat07:58:371
25046999518,30cyclictest28877-21/usr/sbin/munin07:08:510
25046999516,29cyclictest20083-21grep11:19:010
25057999437,7cyclictest0-21swapper/109:53:501
25057999436,8cyclictest0-21swapper/111:28:531
2505799943,44cyclictest4066-21grep09:58:591
25062999346,10cyclictest22958-21/usr/sbin/munin12:18:512
2506299934,36cyclictest25828-21ssh11:28:542
25057999334,15cyclictest0-21swapper/109:24:061
2505799933,35cyclictest25712-21/usr/sbin/munin08:38:501
2505799933,35cyclictest25712-21/usr/sbin/munin08:38:501
25057999331,11cyclictest0-21swapper/111:43:541
25057999329,12cyclictest0-21swapper/108:44:101
25057999329,11cyclictest0-21swapper/109:44:081
25057999329,11cyclictest0-21swapper/109:44:081
2505799932,36cyclictest25236-21wc06:58:501
25046999369,18cyclictest12216-21kworker/u18:3+events_unbound08:13:330
25046999326,31cyclictest0-21swapper/011:58:430
25046999326,31cyclictest0-21swapper/011:58:430
25057999238,7cyclictest0-21swapper/111:09:051
25057999238,7cyclictest0-21swapper/111:09:051
2505799923,33cyclictest29978-21/usr/sbin/munin09:49:241
2505799923,33cyclictest29978-21/usr/sbin/munin09:49:241
25057999229,9cyclictest0-21swapper/111:04:081
25046999247,33cyclictest0-21swapper/012:08:360
25057999139,8cyclictest0-21swapper/109:21:491
25057999138,11cyclictest3217-21if_eth007:28:551
25057999138,11cyclictest3217-21if_eth007:28:551
25057999136,13cyclictest0-21swapper/110:03:521
25057999134,8cyclictest0-21swapper/110:58:431
25057999134,8cyclictest0-21swapper/110:58:431
25057999133,9cyclictest0-21swapper/110:28:461
25057999133,8cyclictest0-21swapper/107:23:491
2505799913,35cyclictest24545-21/usr/sbin/munin10:34:051
2505799913,34cyclictest32237-21/usr/sbin/munin08:58:441
2505799913,32cyclictest32472-21sed07:18:581
25057999130,11cyclictest0-21swapper/107:38:351
25057999130,11cyclictest0-21swapper/107:38:351
2504699913,79cyclictest27907-21taskset10:39:000
25046999123,40cyclictest10867-21fschecks_time11:03:540
25046999118,28cyclictest7954-21apt-get07:43:580
2505799905,31cyclictest2334-21/usr/sbin/munin10:49:301
2505799904,31cyclictest5020-21/usr/sbin/munin11:48:491
25057999034,7cyclictest0-21swapper/111:13:581
25057999033,9cyclictest0-21swapper/109:38:391
2505799903,36cyclictest23920-21ls12:19:081
2505799903,34cyclictest8770-21/usr/sbin/munin09:14:061
2505799903,34cyclictest20208-21grep08:19:101
2505799903,33cyclictest22662-21cstates11:23:511
2505799903,33cyclictest22662-21cstates11:23:511
2505799894,31cyclictest20615-21ssh11:19:111
2505799893,42cyclictest28970-21timerwakeupswit10:39:381
2505799893,37cyclictest11409-21if_eth011:58:561
2505799893,37cyclictest11409-21if_eth011:58:561
2505799893,34cyclictest5538-21runrttasks09:08:351
2505799893,34cyclictest31272-21timerandwakeup07:14:091
2505799893,34cyclictest26809-21munin-node10:43:421
2505799892,33cyclictest16113-21/usr/sbin/munin10:19:001
2504699898,48cyclictest0-21swapper/011:23:490
2504699898,48cyclictest0-21swapper/011:23:490
25046998957,22cyclictest13825-21fschecks_count11:08:520
25046998957,22cyclictest13825-21fschecks_count11:08:520
25046998955,25cyclictest668-21ssh08:59:100
25046998921,27cyclictest20711-21rm10:27:040
25046998920,21cyclictest11980-21ssh09:18:530
25062998856,9cyclictest181rcu_preempt06:58:492
2505799884,33cyclictest32135-21/usr/sbin/munin11:39:041
2505799884,32cyclictest10568-21head07:49:251
2505799883,39cyclictest6404-21ssh10:56:081
2505799883,33cyclictest28977-21cpuspeed07:08:501
2505799883,33cyclictest17880-21taskset12:09:071
2505799883,32cyclictest12932-21ssh10:13:561
25057998827,12cyclictest0-21swapper/107:08:361
25057998827,12cyclictest0-21swapper/107:08:361
2505799873,32cyclictest16321-21fschecks_time08:08:541
2505799873,31cyclictest14619-21fschecks_count08:03:541
25057998732,7cyclictest0-21swapper/107:38:511
25057998725,15cyclictest0-21swapper/111:58:031
2505799872,37cyclictest21237-21kernelversion08:23:591
2505799872,31cyclictest26965-21unixbench_multi12:24:071
2505799872,31cyclictest26965-21unixbench_multi12:24:071
25046998750,27cyclictest0-21swapper/010:28:550
25046998723,25cyclictest21490-21find08:24:060
2505799863,35cyclictest22769-21fschecks_time08:28:551
2505799863,32cyclictest20280-21runrttasks12:13:541
2505799863,31cyclictest9582-21/usr/sbin/munin10:08:541
2505799863,31cyclictest9582-21/usr/sbin/munin10:08:541
2505799862,34cyclictest19048-21latency_hist08:18:351
25046998620,24cyclictest10155-21awk10:09:000
25046998620,24cyclictest10155-21awk10:09:000
2506299853,63cyclictest22582-21kworker/u17:1+ext4-rsv-conversion09:48:572
2506299853,63cyclictest22582-21kworker/u17:1+ext4-rsv-conversion09:48:572
2505799853,33cyclictest18561-21/usr/sbin/munin10:24:121
2505799853,31cyclictest30487-21latency_hist08:53:361
2505799843,30cyclictest31929-21latency_hist08:58:351
25046998424,39cyclictest9414-21ntp_states09:14:030
25046998424,26cyclictest2094-21fschecks_time10:49:240
25046998418,27cyclictest6741-21sh10:57:060
25046998415,30cyclictest7079-21awk07:39:100
25062998361,16cyclictest25037-21cyclictest11:10:312
25062998361,16cyclictest25037-21cyclictest11:10:312
25057998321,20cyclictest17751-21sh09:28:411
2504699833,66cyclictest23737-21/usr/sbin/munin09:38:560
25046998321,24cyclictest26306-21grep08:39:060
25046998321,24cyclictest26306-21grep08:39:060
25046998248,24cyclictest14130-21sshd10:15:210
25046998223,26cyclictest277-21dbus-daemon09:48:350
25046998223,26cyclictest277-21dbus-daemon09:48:350
25046998218,26cyclictest12639-21latency_hist07:58:360
2506799813,38cyclictest20646-21taskset12:14:053
25062998160,15cyclictest25037-21cyclictest09:36:482
25062998160,15cyclictest25037-21cyclictest09:36:482
25062998144,30cyclictest10674-21kworker/u19:1+nfsiod09:17:512
25046998123,48cyclictest10811-21latency_hist11:58:350
25046998118,23cyclictest23466-21basename09:38:330
25046998118,23cyclictest23466-21basename09:38:330
2504699803,37cyclictest25930-21/usr/sbin/munin12:24:070
2504699803,37cyclictest25930-21/usr/sbin/munin12:24:070
25046998015,20cyclictest17504-21ssh09:28:340
25046998014,32cyclictest7258-21ssh09:10:080
25046997957,14cyclictest32012-21ssh10:44:280
25046997921,24cyclictest19123-21cat08:18:350
25046997919,22cyclictest0-21swapper/011:43:550
25046997916,24cyclictest27023-21munin-node07:03:420
25046997916,24cyclictest27023-21munin-node07:03:420
25046997915,28cyclictest16419-21/usr/sbin/munin10:19:080
25062997861,9cyclictest20518-21needreboot12:14:002
25062997858,14cyclictest2374-21systemd-journal09:43:342
25062997856,15cyclictest2374-21systemd-journal11:42:222
25062997855,12cyclictest0-21swapper/210:54:102
2504699789,25cyclictest0-21swapper/010:03:490
25046997820,23cyclictest25394-21sort06:58:550
25046997819,22cyclictest7841-21grep10:58:540
25046997819,22cyclictest7841-21grep10:58:540
25046997818,23cyclictest18127-21ssh11:15:260
25046997817,26cyclictest19545-21rm09:31:010
25046997814,24cyclictest26161-21/usr/sbin/munin11:29:020
25046997813,25cyclictest21548-21ssh12:15:240
25046997811,26cyclictest10933-21/usr/sbin/munin07:53:340
25062997757,15cyclictest7730-21idleruntime-cro11:53:322
25062997750,18cyclictest22712-21sh11:23:522
25062997750,18cyclictest22712-21sh11:23:522
25046997717,23cyclictest5206-21rm10:00:360
25062997655,15cyclictest14681-21processes12:04:062
2504699769,26cyclictest1238-21/usr/sbin/munin07:23:560
2504699765,41cyclictest0-21swapper/011:41:150
25046997646,20cyclictest19270-21apt-get08:18:490
25046997644,25cyclictest17016-21apt-get12:08:460
2504699764,35cyclictest22958-21/usr/sbin/munin12:19:050
2504699763,37cyclictest28982-21cpu08:48:500
25046997621,24cyclictest1162-21ntpq09:54:010
25046997617,27cyclictest0-21swapper/008:34:010
25046997616,22cyclictest5474-21munin-run09:08:330
25046997613,24cyclictest27330-21systemd-run10:38:340
2506799753,49cyclictest27865-21taskset10:38:533
25062997547,10cyclictest181rcu_preempt08:53:492
25062997543,23cyclictest14551-21wc09:23:352
25046997519,22cyclictest13319-21ntpq07:59:030
25046997513,27cyclictest6059-21sed07:38:360
25046997512,25cyclictest23278-21ls08:29:070
25062997458,11cyclictest16537-21sh11:13:422
25062997451,14cyclictest297-21systemd-logind12:28:342
25062997451,14cyclictest297-21systemd-logind12:28:342
25046997415,21cyclictest0-21swapper/007:13:550
2506299734,49cyclictest4830-21latency_hist11:48:352
25046997330,33cyclictest0-21swapper/011:48:470
25046997314,28cyclictest2887-21cat07:28:420
25046997314,28cyclictest2887-21cat07:28:420
25046997312,27cyclictest27889-21open_files08:44:050
25046997312,25cyclictest32102-21latency_hist08:58:360
25062997256,11cyclictest25037-21cyclictest07:58:352
25062997156,9cyclictest14107-21kworker/u17:1-writeback11:03:382
25062997154,10cyclictest1535-21fschecks_time07:23:552
25062997142,8cyclictest0-21swapper/210:13:492
25046997112,26cyclictest1111-21wc07:23:360
25062997054,11cyclictest25037-21cyclictest12:01:192
25062997054,11cyclictest25037-21cyclictest12:01:192
25062997050,14cyclictest300-21rs:main2
25062997050,14cyclictest300-21rs:main2
25062997047,13cyclictest0-21swapper/210:34:052
25062997026,33cyclictest17386-21modprobe08:13:332
25062996954,10cyclictest19676-21snmpd09:10:042
25062996949,9cyclictest0-21swapper/208:48:552
2506299693,45cyclictest21670-21cpuspeed10:28:482
25062996851,9cyclictest0-21swapper/207:14:102
2506299684,44cyclictest18597-21/usr/sbin/munin08:14:102
25062996838,19cyclictest1362-21apt-key10:48:372
25062996838,10cyclictest181rcu_preempt07:58:462
306992670,6sleep30-21swapper/308:53:503
2506299675,41cyclictest352-21runrttasks08:32:412
25062996749,12cyclictest17706-21latency_hist09:28:372
2506299673,43cyclictest4318-21latency_hist07:33:362
2506299673,43cyclictest4318-21latency_hist07:33:362
2506299673,36cyclictest20626-21awk08:23:332
2506299672,43cyclictest352-21runrttasks09:28:472
25062996653,9cyclictest25037-21cyclictest10:13:342
25062996653,9cyclictest25037-21cyclictest10:13:342
2506299664,35cyclictest352-21runrttasks07:10:202
25062996643,17cyclictest0-21swapper/208:28:352
25062996643,11cyclictest0-21swapper/212:09:002
2506299663,46cyclictest567-21/usr/sbin/munin09:54:072
2506299663,43cyclictest7753-21apt-config07:43:362
2506299663,41cyclictest28102-21timerandwakeup08:44:082
2506299654,35cyclictest352-21runrttasks08:04:242
25062996543,16cyclictest3199-21sh09:03:582
25062996539,17cyclictest11085-21ntpd11:18:522
25062996534,22cyclictest31179-21modprobe11:38:322
2506299653,40cyclictest18817-21fschecks_count10:23:552
25062996533,13cyclictest0-21swapper/207:53:362
2506299652,46cyclictest400-21threads07:19:082
2356526510,33sleep123556-21apt-get06:53:491
25062996437,14cyclictest0-21swapper/210:19:072
25062996434,20cyclictest27953-21grep07:04:102
25062996434,20cyclictest27953-21grep07:04:102
2506299643,38cyclictest24595-21ntp_kernel_err08:34:012
2402426413,28sleep20-21swapper/206:54:072
2506299635,42cyclictest7994-21http07:44:242
25062996344,14cyclictest7575-21apt10:58:482
25062996344,14cyclictest7575-21apt10:58:482
2506299633,34cyclictest32576-21fschecks_time08:58:572
2504699633,43cyclictest5085-21grep07:34:070
2506799629,21cyclictest0-21swapper/310:48:573
2506799614,42cyclictest13760-21taskset12:03:353
2506799614,42cyclictest13760-21taskset12:03:353
250842590,11sleep3451rcuc/308:34:103
2506799595,37cyclictest12216-21chrt11:05:403
25067995912,23cyclictest0-21swapper/307:44:043
2506799563,38cyclictest29254-21chrt08:48:563
2506799553,36cyclictest21147-21chrt09:33:563
2506799553,36cyclictest21147-21chrt09:33:563
2506799552,37cyclictest13666-21chrt07:59:103
2506799552,36cyclictest11819-21taskset09:18:483
2506799552,36cyclictest11518-21taskset09:18:353
2506799543,35cyclictest27400-21chrt07:03:543
2506799543,35cyclictest27400-21chrt07:03:543
2506799543,35cyclictest18512-21chrt10:23:373
2506799543,33cyclictest7684-21chrt07:43:363
2506799543,31cyclictest25717-21chrt08:38:443
2506799543,31cyclictest25717-21chrt08:38:443
2506799542,39cyclictest12419-21taskset10:13:363
2506799542,39cyclictest12419-21taskset10:13:363
2506799533,38cyclictest3592-21chrt09:58:443
2506799533,38cyclictest16882-21chrt11:13:543
2506799533,37cyclictest29115-21chrt11:34:013
2506799532,35cyclictest16260-21chrt09:25:163
2506799524,31cyclictest22700-21chrt11:23:513
2506799524,31cyclictest22700-21chrt11:23:513
2506799523,35cyclictest9781-21chrt07:49:103
2506799523,35cyclictest8301-21chrt11:53:543
2506799523,35cyclictest1260-21taskset09:00:113
2506799523,34cyclictest21355-21chrt08:24:013
2506799523,33cyclictest25824-21taskset11:28:543
2506799523,32cyclictest24856-21chrt09:39:113
2506799523,30cyclictest1796-21taskset07:24:033
2506799522,38cyclictest21847-21taskset11:22:343
2506799522,35cyclictest4874-21chrt11:48:353
2506799513,33cyclictest6589-21chrt09:09:073
2506799513,33cyclictest5250-21chrt10:54:053
2506799513,32cyclictest25364-21chrt10:34:063
2506799513,31cyclictest11933-21chrt07:54:083
2506799512,37cyclictest7453-21chrt11:52:493
2506799512,37cyclictest30801-21taskset10:43:433
2506799508,27cyclictest0-21swapper/309:48:573
2506799508,27cyclictest0-21swapper/309:48:573
2506799503,36cyclictest668-21taskset11:40:373
2506799503,33cyclictest15117-21chrt12:04:123
2506799502,35cyclictest7454-21taskset10:04:073
2506799502,33cyclictest1685-21chrt09:54:103
2506799502,31cyclictest7896-21chrt10:58:553
2506799502,31cyclictest7896-21chrt10:58:553
2506799493,33cyclictest21323-21chrt10:28:353
2506799492,35cyclictest24265-21chrt12:19:403
2506799492,34cyclictest28809-21chrt12:28:363
2506799492,34cyclictest28809-21chrt12:28:363
2506799492,34cyclictest19275-21taskset12:12:273
2506799492,34cyclictest18210-21taskset08:14:053
2506799483,33cyclictest15766-21chrt11:12:123
2506799483,33cyclictest15766-21chrt11:12:123
2506799482,30cyclictest13919-21chrt10:14:453
2506799473,32cyclictest29351-21chrt07:09:013
2506799473,32cyclictest19508-21chrt08:18:553
2506799473,30cyclictest5867-21taskset07:38:333
2506799473,30cyclictest5867-21taskset07:38:333
2506799462,31cyclictest29137-21taskset09:47:463
2506799462,31cyclictest29137-21taskset09:47:463
235682466,21sleep30-21swapper/306:53:513
2506799453,29cyclictest3100-21taskset09:03:563
2506799452,30cyclictest3141-21chrt07:28:533
2506799452,30cyclictest3141-21chrt07:28:533
2506799444,29cyclictest31950-21taskset07:18:363
2506799443,32cyclictest20434-21chrt09:33:313
2506799433,28cyclictest25193-21chrt06:58:403
2506799433,28cyclictest16599-21taskset08:09:033
2506799433,27cyclictest23053-21taskset08:29:043
2506799422,28cyclictest14416-21taskset08:03:443
2506799413,28cyclictest27977-21taskset08:44:063
2506799413,27cyclictest23359-21chrt10:31:023
2506799392,26cyclictest32265-21chrt07:18:533
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional