You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-03-22 - 14:33
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of all highest latencies:
System rackbslot7.osadl.org (updated Sun Mar 22, 2026 00:44:33)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
1038321590,18sleep2371rcuc/219:00:152
11495991263,49cyclictest25446-21ssh23:04:580
2942621130,5sleep129427-21sh00:05:301
11499991112,63cyclictest31142-21apt-get22:20:061
114959910938,64cyclictest3303-21ssh22:26:570
11495991093,29cyclictest24447-21/usr/sbin/munin23:56:340
11495991085,45cyclictest2340-21cut23:20:100
11495991085,45cyclictest2340-21cut23:20:100
11495991063,30cyclictest28834-21ssh22:15:210
11495991063,30cyclictest28834-21ssh22:15:210
114959910624,24cyclictest17213-21/usr/sbin/munin23:45:110
114959910531,8cyclictest0-21swapper/023:40:190
114959910520,28cyclictest21970-21/usr/sbin/munin22:05:130
114959910434,8cyclictest0-21swapper/021:04:560
11495991043,34cyclictest28600-21/usr/sbin/munin23:10:070
11495991043,34cyclictest28600-21/usr/sbin/munin23:10:070
11495991043,32cyclictest10081-21/usr/sbin/munin21:45:020
11495991043,32cyclictest10081-21/usr/sbin/munin21:45:020
11495991043,31cyclictest19624-21cstates22:55:020
114959910417,22cyclictest9102-21apt-get20:35:490
114959910417,22cyclictest9102-21apt-get20:35:490
11495991033,36cyclictest30651-21/usr/sbin/munin21:25:070
11495991033,34cyclictest16699-21diskstats22:50:050
11495991033,34cyclictest16699-21diskstats22:50:050
11495991033,33cyclictest22067-21grep21:10:080
11495991033,32cyclictest13531-21/usr/sbin/munin22:45:100
11495991023,38cyclictest31777-21needreboot22:20:330
11495991023,34cyclictest29872-21/usr/sbin/munin20:00:040
1033321029,63sleep110382-21/usr/sbin/munin19:00:151
114959910135,58cyclictest0-21swapper/022:39:590
114959910135,58cyclictest0-21swapper/022:39:590
11495991013,39cyclictest32262-21sort20:05:210
11495991013,39cyclictest18451-21diskmemload21:15:210
11495991013,39cyclictest18451-21diskmemload21:15:210
11495991013,36cyclictest22407-21modprobe23:54:460
11495991013,27cyclictest11519-21ssh00:30:010
11495991013,27cyclictest11519-21ssh00:30:010
114959910125,13cyclictest0-21swapper/022:02:230
11495991012,35cyclictest28040-21fschecks_time21:20:090
11495991012,34cyclictest12503-21fschecks_time20:45:070
11495991012,33cyclictest8391-21ssh23:30:140
11495991004,41cyclictest26895-21grep19:50:070
11495991004,35cyclictest873-21fschecks_time20:10:070
11495991004,35cyclictest873-21fschecks_time20:10:070
114959910040,52cyclictest0-21swapper/022:13:140
114959910040,52cyclictest0-21swapper/022:13:140
11495991003,34cyclictest28256-21/usr/sbin/munin19:55:250
11495991002,44cyclictest24494-21chrt23:03:000
11495991002,44cyclictest24494-21chrt23:03:000
11495991002,35cyclictest20174-21/usr/sbin/munin19:30:150
11495991002,33cyclictest20164-1kworker/0:0H+mmc_complete19:04:490
11507999974,18cyclictest15191-21latency_hist19:14:482
1149599996,36cyclictest31977-21latency_hist00:09:480
1149599994,37cyclictest3315-21diskmemload00:15:190
1149599994,36cyclictest16365-21fschecks_time21:55:090
1149599993,34cyclictest7316-21taskset23:29:140
1149599993,32cyclictest17624-21cut19:20:190
1149599993,32cyclictest13635-21grep19:09:560
1149599993,31cyclictest22090-21fschecks_time19:35:080
1149599993,29cyclictest8544-21/usr/sbin/munin00:25:010
11495999840,50cyclictest5235-21latency_hist20:24:480
11495999834,10cyclictest0-21swapper/021:42:540
1149599983,36cyclictest8365-21latency_hist00:24:480
1149599983,36cyclictest8365-21latency_hist00:24:480
1149599983,36cyclictest26495-21latency_hist19:49:480
1149599983,36cyclictest26495-21latency_hist19:49:480
1149599983,34cyclictest1155-21/usr/sbin/munin21:29:540
1149599983,33cyclictest7090-21/usr/sbin/munin20:30:190
11495999824,12cyclictest0-21swapper/020:55:100
11495999824,12cyclictest0-21swapper/020:55:100
11495999824,12cyclictest0-21swapper/020:29:490
1149599973,38cyclictest28990-21apt-key00:04:490
1149599973,35cyclictest5241-21sh22:30:170
1149599973,34cyclictest1706-21latency_hist23:19:470
1149599973,32cyclictest11566-21/usr/sbin/munin20:40:580
11507999649,41cyclictest200-21systemd-journal21:53:412
1149599963,34cyclictest17793-21grep21:00:210
1149599963,31cyclictest11051-21fschecks_count23:35:060
1149599963,30cyclictest15708-21modprobe21:54:450
1149599962,31cyclictest18985-21latency19:25:110
11495999612,27cyclictest32400-21/usr/sbin/munin00:10:090
11495999612,27cyclictest32400-21/usr/sbin/munin00:10:090
1149599953,36cyclictest24349-21unixbench_multi19:40:220
1149599953,36cyclictest24349-21unixbench_multi19:40:220
1149599953,34cyclictest13124-21latency_hist19:09:480
1149599953,34cyclictest13124-21latency_hist19:09:480
1149599952,36cyclictest2540-21fschecks_time20:15:070
1149599952,33cyclictest14201-21kernelversion20:50:110
11495999516,25cyclictest4839-21proc_pri21:35:180
11495999516,25cyclictest4839-21proc_pri21:35:180
1149599933,32cyclictest10507-21latency_hist22:39:490
11507999250,35cyclictest0-21swapper/222:21:362
1150799913,33cyclictest4262-21kernelversion20:20:132
1150799913,33cyclictest32261-21ls20:05:212
11507999116,28cyclictest277-21dbus-daemon19:19:472
1149599913,34cyclictest15590-21grep19:15:070
11507999041,43cyclictest32037-21/usr/sbin/munin00:10:192
11507999041,43cyclictest32037-21/usr/sbin/munin00:10:192
11507999039,45cyclictest10210-21sh22:39:402
11507998953,30cyclictest22644-21latency_hist23:54:492
1150799883,33cyclictest835-21fschecks_count20:10:062
1150799883,33cyclictest835-21fschecks_count20:10:062
1150799883,31cyclictest12247-21cpu20:45:002
1150799882,31cyclictest19474-21/usr/sbin/munin22:55:102
11499998865,15cyclictest11481-21cyclictest22:29:471
11507998740,41cyclictest18451-21diskmemload23:55:252
11507998738,42cyclictest14073-21sh00:34:372
11507998738,42cyclictest14073-21sh00:34:372
11507998737,45cyclictest11481-21cyclictest00:05:342
1150799873,34cyclictest21570-21ls21:09:482
1150799873,31cyclictest25769-21tail21:15:232
1150799873,31cyclictest25769-21tail21:15:232
1150799872,34cyclictest22188-21latency21:10:112
11507998643,37cyclictest18451-21diskmemload21:55:542
11507998639,39cyclictest352-21runrttasks21:39:402
11507998639,39cyclictest352-21runrttasks21:39:402
11507998638,40cyclictest0-21swapper/222:45:032
11507998637,42cyclictest0-21swapper/219:34:482
1150799863,34cyclictest1155-21/usr/sbin/munin21:30:092
1150799863,31cyclictest13453-21latency_hist22:44:492
1150799863,31cyclictest13453-21latency_hist22:44:492
1150799863,29cyclictest25832-21runrttasks22:10:222
1150799863,29cyclictest25832-21runrttasks22:10:222
11499998657,15cyclictest0-21swapper/119:49:451
11499998657,15cyclictest0-21swapper/119:49:451
11507998540,38cyclictest0-21swapper/221:20:352
11507998533,44cyclictest0-21swapper/219:49:482
11507998533,44cyclictest0-21swapper/219:49:482
11507998529,49cyclictest16540-21wc22:50:012
11507998529,49cyclictest16540-21wc22:50:012
11507998526,49cyclictest22339-21ls22:05:092
1150799852,30cyclictest8337-21runrttasks00:24:482
1150799852,30cyclictest8337-21runrttasks00:24:482
1150799844,32cyclictest352-21runrttasks22:27:402
11507998436,42cyclictest18451-21diskmemload00:24:492
11507998433,43cyclictest0-21swapper/219:25:022
1150799843,33cyclictest28590-21apt-config00:04:452
1150799843,32cyclictest15301-21latency_hist20:54:482
11507998423,53cyclictest0-21swapper/223:20:132
11507998423,53cyclictest0-21swapper/223:20:132
1150799842,34cyclictest5213-21/usr/sbin/munin22:30:162
11507998422,24cyclictest13813-21ssh23:40:002
11499998457,20cyclictest25985-21sort00:00:021
1151699832,34cyclictest1817-21chrt21:30:163
11507998363,15cyclictest0-21swapper/220:30:212
1150799834,30cyclictest30839-21head20:00:232
1150799834,28cyclictest27567-21/usr/sbin/munin19:50:212
11507998336,40cyclictest0-21swapper/221:45:112
11507998336,40cyclictest0-21swapper/221:45:112
1150799833,32cyclictest22474-21mailstats19:35:192
1150799833,32cyclictest17242-21/usr/sbin/munin23:45:112
1150799833,29cyclictest25401-21/usr/sbin/munin23:05:182
1150799833,27cyclictest28367-21/usr/sbin/munin23:10:072
1150799833,27cyclictest28367-21/usr/sbin/munin23:10:072
11507998265,11cyclictest9268-21fschecks_count20:36:022
11507998265,11cyclictest9268-21fschecks_count20:36:022
1150799823,33cyclictest10763-21ls20:40:392
1150799823,32cyclictest19015-21/usr/sbin/munin22:00:232
1150799823,32cyclictest17794-21wc21:00:212
1150799823,31cyclictest2379-21cstates20:15:022
1150799823,30cyclictest17596-21wc19:20:192
1150799823,29cyclictest31932-21runrttasks21:25:492
11507998227,47cyclictest0-21swapper/220:55:072
11507998227,47cyclictest0-21swapper/220:55:072
1150799822,34cyclictest8662-21switchtime23:30:212
1150799822,31cyclictest28836-21timerandwakeup22:15:212
1150799822,31cyclictest28836-21timerandwakeup22:15:212
1150799814,31cyclictest6137-21mailstats20:25:182
1150799813,32cyclictest2585-21/usr/sbin/munin00:15:222
1150799813,30cyclictest5858-21ssh23:25:222
1150799813,29cyclictest9986-21latency_hist21:44:492
1150799812,34cyclictest24332-21grep19:40:222
1150799812,34cyclictest24332-21grep19:40:222
1149999814,41cyclictest19409-21modprobe23:49:451
1151699804,35cyclictest11678-21chrt00:30:053
1151699804,35cyclictest11678-21chrt00:30:053
1150799803,33cyclictest11959-21fschecks_time19:05:082
1150799803,33cyclictest11959-21fschecks_time19:05:082
1150799803,32cyclictest31707-21fschecks_time23:15:082
11507998024,8cyclictest0-21swapper/223:38:132
11507997923,9cyclictest0-21swapper/223:00:112
11507997923,9cyclictest0-21swapper/223:00:112
1150799792,31cyclictest28522-21fschecks_time19:55:092
11499997858,14cyclictest22423-40mandb23:54:491
1149999783,50cyclictest22935-21apt-get23:55:031
1151699773,28cyclictest16936-21chrt20:59:473
1151699773,28cyclictest16936-21chrt20:59:473
1149999778,56cyclictest9101-21taskset20:35:491
1149999778,56cyclictest9101-21taskset20:35:491
11499997558,13cyclictest14133-21kworker/u17:3+events_unbound21:54:451
11499997449,16cyclictest0-21swapper/120:25:201
11499997350,14cyclictest12237-21ssh22:41:581
11499997350,14cyclictest12237-21ssh22:41:581
1149999732,47cyclictest1799-21latency_hist23:19:481
11499997257,11cyclictest11481-21cyclictest22:00:121
11499997250,16cyclictest19778-21fschecks_time22:55:071
11499997249,15cyclictest4737-21cpuspeed22:30:041
11499997248,16cyclictest18451-21diskmemload22:35:021
11499997153,10cyclictest0-21swapper/123:00:161
11499997153,10cyclictest0-21swapper/123:00:161
11499997152,13cyclictest365-21ntpd21:55:181
11499997142,20cyclictest15566-21cut19:15:071
11499997051,14cyclictest4775-21ntp_offset21:35:151
11499997051,14cyclictest4775-21ntp_offset21:35:151
11499996950,12cyclictest18451-21diskmemload23:44:481
11499996949,10cyclictest0-21swapper/121:30:211
11499996943,16cyclictest14346-21diskmemload22:45:211
1149999692,46cyclictest11850-21chrt21:47:121
1149999692,46cyclictest11850-21chrt21:47:121
1151699686,41cyclictest9033-21chrt20:35:003
1151699686,41cyclictest9033-21chrt20:35:003
11499996851,11cyclictest25401-21/usr/sbin/munin23:05:001
11499996846,12cyclictest0-21swapper/123:39:461
11499996843,19cyclictest16866-21if_err_eth022:50:081
11499996843,19cyclictest16866-21if_err_eth022:50:081
1149999684,25cyclictest31-21ksoftirqd/121:07:011
11499996813,41cyclictest6236-21grep00:20:181
11499996813,41cyclictest6236-21grep00:20:181
11499996750,11cyclictest298-21in:imuxsock20:24:451
11499996746,14cyclictest11481-21cyclictest23:13:121
11499996746,14cyclictest11481-21cyclictest23:13:121
11499996745,16cyclictest22618-21ssh21:10:211
1149999674,46cyclictest19304-21cat19:25:191
1149999673,39cyclictest28539-21fschecks_time19:55:091
11499996724,10cyclictest301ktimers/123:20:051
11499996724,10cyclictest301ktimers/123:20:051
11499996642,18cyclictest32246-21threads20:05:211
1149999663,42cyclictest13716-21/usr/sbin/munin19:09:581
1149999662,46cyclictest12919-21swap20:45:181
11499996619,10cyclictest14088-21tune2fs20:50:081
11499996613,25cyclictest0-21swapper/120:59:481
11499996613,25cyclictest0-21swapper/120:59:481
11499996549,10cyclictest277-21dbus-daemon23:29:461
11499996548,12cyclictest1165-21runrttasks00:11:421
11499996548,12cyclictest1165-21runrttasks00:11:421
11499996548,10cyclictest0-21swapper/122:05:031
11499996544,15cyclictest1-21systemd19:05:421
11499996544,15cyclictest1-21systemd19:05:421
11499996544,11cyclictest0-21swapper/121:20:191
11499996543,16cyclictest9183-21proc_pri00:25:191
1149999653,44cyclictest7288-21fschecks_count20:30:071
11499996532,23cyclictest12094-21cat20:44:481
1149999644,36cyclictest352-21runrttasks20:10:071
1149999644,36cyclictest352-21runrttasks20:10:071
11499996442,12cyclictest0-21swapper/119:44:481
11499996442,12cyclictest0-21swapper/119:44:481
1149999643,45cyclictest20274-21ls19:30:041
1149999643,45cyclictest17080-21/usr/sbin/munin21:00:191
1149999643,44cyclictest352-21runrttasks20:19:211
1149999643,44cyclictest352-21runrttasks19:50:551
1058826423,21sleep30-21swapper/319:00:263
1151699633,45cyclictest17261-21taskset21:00:083
11499996339,18cyclictest544-21cron21:29:461
11499996339,16cyclictest8711-21sh21:41:441
1149999633,42cyclictest7811-21/usr/sbin/munin23:30:151
1149999633,41cyclictest25544-21ssh22:10:151
1149999633,41cyclictest25544-21ssh22:10:151
1149999633,31cyclictest17821-21timerwakeupswit19:20:211
1149999632,45cyclictest30613-21cat20:00:211
1149999623,40cyclictest27572-21date21:19:491
1149999623,40cyclictest27572-21date21:19:491
1149999622,39cyclictest2585-21/usr/sbin/munin00:15:091
1151699616,37cyclictest22908-21chrt23:54:543
1151699603,40cyclictest14220-21taskset21:50:313
1149999602,40cyclictest21804-21/usr/sbin/munin19:35:101
1149999602,37cyclictest11814-21fschecks_time00:30:081
1149999602,37cyclictest11814-21fschecks_time00:30:081
1151699593,37cyclictest4195-21taskset00:16:473
1149999593,41cyclictest28217-21ssh22:15:071
1149999593,41cyclictest28217-21ssh22:15:071
1151699583,39cyclictest5604-21taskset22:30:243
1151699583,38cyclictest6183-21chrt00:20:163
1151699583,38cyclictest6183-21chrt00:20:163
1151699573,40cyclictest24017-21chrt21:13:413
1151699573,40cyclictest17219-21chrt22:50:183
1151699573,40cyclictest17219-21chrt22:50:183
1151699573,39cyclictest25150-21taskset19:45:033
1151699573,39cyclictest25150-21taskset19:45:033
1151699573,36cyclictest26978-21taskset19:50:093
1151699572,39cyclictest2490-21chrt23:20:133
1151699572,39cyclictest2490-21chrt23:20:133
1151699564,38cyclictest8388-21chrt23:30:143
1151699564,38cyclictest20520-21taskset23:50:203
1151699564,38cyclictest18320-21taskset19:24:463
1151699564,36cyclictest32258-21chrt00:10:063
1151699564,36cyclictest32258-21chrt00:10:063
1151699564,36cyclictest11178-21chrt00:29:443
1151699564,35cyclictest25925-21taskset23:05:103
1151699563,38cyclictest15738-21chrt23:42:463
1151699563,36cyclictest9070-21chrt21:42:443
1151699563,35cyclictest26116-21chrt21:16:093
1151699563,35cyclictest26116-21chrt21:16:093
1151699555,33cyclictest14680-21chrt19:10:243
1151699553,39cyclictest8673-21taskset20:34:483
1151699553,36cyclictest21992-21chrt19:35:073
1151699553,35cyclictest12109-21chrt23:35:533
1151699553,34cyclictest21564-21chrt19:34:463
1151699543,36cyclictest29904-21taskset00:05:453
1151699543,32cyclictest19366-21taskset21:05:143
1151699543,30cyclictest6290-21chrt20:25:203
1151699542,39cyclictest2561-21taskset22:25:213
1151699542,35cyclictest26404-21chrt22:11:223
1151699542,35cyclictest26404-21chrt22:11:223
1151699533,36cyclictest8052-21chrt22:35:103
1151699533,35cyclictest15107-21chrt22:46:413
1151699533,34cyclictest28213-21chrt22:15:073
1151699533,34cyclictest28213-21chrt22:15:073
1151699532,34cyclictest14381-21chrt20:50:163
1151699522,37cyclictest5151-21taskset21:35:223
1151699522,37cyclictest5151-21taskset21:35:223
1151699522,33cyclictest32004-21chrt23:15:153
1151699515,32cyclictest912-21chrt21:29:473
1151699513,34cyclictest10244-21taskset21:45:033
1151699513,34cyclictest10244-21taskset21:45:033
1151699513,32cyclictest28678-21chrt00:04:473
1151699512,33cyclictest29100-21chrt21:21:123
1151699512,33cyclictest17999-21chrt21:57:443
1151699512,31cyclictest19698-21chrt22:55:043
1151699504,35cyclictest17691-21taskset23:45:213
1151699504,28cyclictest28372-21chrt23:09:563
1151699504,28cyclictest28372-21chrt23:09:563
1151699502,33cyclictest23903-21chrt22:07:413
1151699494,29cyclictest2091-21taskset20:14:473
1151699494,29cyclictest2091-21taskset20:14:473
1151699493,34cyclictest19198-21chrt22:00:033
11516994932,9cyclictest240342chrt23:01:413
11516994932,9cyclictest240342chrt23:01:413
1151699492,33cyclictest322-21chrt22:21:563
1151699482,33cyclictest18671-21taskset19:25:023
1151699473,32cyclictest11840-21chrt22:40:503
1151699473,32cyclictest11840-21chrt22:40:503
1151699473,31cyclictest15902-21taskset19:15:143
1151699464,29cyclictest23580-21taskset19:40:053
1151699464,29cyclictest23580-21taskset19:40:053
1151699462,30cyclictest3903-21taskset20:20:023
1151699443,29cyclictest6043-21chrt23:25:323
1151699443,28cyclictest31500-21taskset20:04:593
1151699443,27cyclictest11852-21taskset19:05:053
1151699443,27cyclictest11852-21taskset19:05:053
1151699442,30cyclictest13619-21taskset20:49:473
1151699434,27cyclictest2287-21chrt20:14:563
1151699433,28cyclictest29302-21taskset19:55:483
11516994327,10cyclictest301702sleep320:00:103
1151699413,25cyclictest10880-21chrt20:40:443
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional