You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-04-26 - 03:21
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.

Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Characteristics of the 376 highest latencies:
System rack5slot1.osadl.org (updated Sun Apr 26, 2026 00:44:04)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
2315439900,9EcMasterDemoSyn2316429tAtEmLog_019:16:365
2315439900,9EcMasterDemoSyn2316429tAtEmLog_019:16:365
1657739830,0EcMasterDemoSyn1658729tAtEmLog_023:35:135
714639820,0EcMasterDemoSyn715629tAtEmLog_023:30:095
3026039820,0EcMasterDemoSyn3027029tAtEmLog_000:36:035
2112839820,0EcMasterDemoSyn2113829tAtEmLog_000:30:585
1947539820,0EcMasterDemoSyn1948529tAtEmLog_020:17:265
1842339810,0EcMasterDemoSyn1843329tAtEmLog_019:06:275
130939810,0EcMasterDemoSyn131929tAtEmLog_020:47:525
60202300,0sleep00-21swapper/023:10:460
3030839280,0EcMasterDemoSyn0-21swapper/419:31:484
1273339240,1EcMasterDemoSyn12740-21grep22:39:264
780399200,17tDemoTimingTask11311-21chrt00:08:065
2598899190,8tDemoTimingTask566-21chrt00:20:155
2188629190,0tAtEmLog_00-21swapper/522:49:335
780129180,8tAtEmLog_014588-21taskset22:58:055
18802991810,6cyclictest17337-21cron20:14:594
1878799181,13cyclictest16-1pr/legacy23:14:541
1878299180,7cyclictest716-21snmpd19:48:010
1878299180,10cyclictest21046-21sh23:01:160
1878299180,10cyclictest21002-21sh21:32:360
1878299180,10cyclictest17802-21sh22:41:370
2316599170,10tDemoTimingTask23764-21chrt19:20:025
1880299179,6cyclictest18711-21sed23:00:174
1878799175,8cyclictest716-21snmpd20:31:371
18787991715,2cyclictest30108-21kworker/1:0+events21:48:431
1878299170,9cyclictest780-21runrttasks21:13:080
1878299170,9cyclictest6596-21ssh22:18:060
1878299170,9cyclictest5529-21runrttasks00:22:500
1878299170,9cyclictest12353-21sh22:56:290
1878299170,14cyclictest5790-21sh23:46:490
1878299170,14cyclictest14708-21sh23:34:200
1878299170,13cyclictest27665-21fschecks_time23:05:150
1749199170,10tDemoTimingTask17618-21chrt21:13:175
766499160,9tDemoTimingTask7902-21chrt19:54:565
2598899160,7tDemoTimingTask29540-21chrt00:18:155
2228539160,7EcMasterDemoSyn23087-21taskset21:34:025
1880299165,8cyclictest16057-21grep22:40:254
18796991612,3cyclictest5812-21cpuspeed_turbos00:05:133
1879699161,11cyclictest367-21sh23:44:243
1879199164,9cyclictest326-21systemd-journal19:18:102
1879199164,9cyclictest326-21systemd-journal19:18:102
1878799162,11cyclictest16-1pr/legacy19:41:571
1878799161,12cyclictest16-1pr/legacy23:50:231
1878799161,12cyclictest16-1pr/legacy21:08:081
1878799160,9cyclictest7085-21sh23:47:441
1878799160,9cyclictest26778-21sh23:40:241
1878299168,6cyclictest25654-21cut23:40:150
1878299164,9cyclictest720-21ntpd22:50:180
1878299164,6cyclictest7175-21find00:05:250
1878299160,11cyclictest24392-21sh23:21:000
1880299154,8cyclictest29134-21head22:30:154
1880299151,10cyclictest29635-21wget20:40:114
1880299150,9cyclictest22028-21sh00:31:364
1880299150,9cyclictest13042-21ssh21:28:344
1880299150,8cyclictest13893-21sh00:27:124
1879699154,8cyclictest18974-21cut00:30:153
1879699153,9cyclictest26213-21wc20:30:233
1879699152,9cyclictest1835-21/usr/sbin/munin23:45:153
1879699151,10cyclictest5418-21ssh22:00:003
1879699150,9cyclictest23460-21idleruntime-cro19:20:003
1879699150,9cyclictest23460-21idleruntime-cro19:20:003
1879699150,10cyclictest4294-21sh00:04:303
1879199157,6cyclictest23026-21cut23:20:192
1879199151,10cyclictest30994-21sh00:19:172
1879199151,10cyclictest19529-21latency_hist23:55:002
1879199151,10cyclictest16778-21chrt21:12:442
1879199151,10cyclictest12424-21diskmemload23:32:432
1879199150,9cyclictest6098-21grep22:00:132
1879199150,9cyclictest31972-21sh22:14:302
1879199150,9cyclictest31893-21rm22:31:282
1879199150,11cyclictest5960-21ssh23:29:302
1879199150,10cyclictest6817-21awk00:05:212
1878799155,5cyclictest6435-21tune2fs19:50:151
1878799154,8cyclictest22408-21aten2_r5power_c20:25:121
1878799153,7cyclictest5689-21aten2_r5power_v00:05:141
18787991513,2cyclictest30108-21kworker/1:0+events20:58:001
18787991511,3cyclictest10277-21turbostat.cron19:59:591
1878799151,12cyclictest16-1pr/legacy23:30:071
1878799151,11cyclictest16-1pr/legacy00:10:411
1878799151,10cyclictest26471-21sh22:29:051
1878799150,9cyclictest28380-21ssh23:23:471
1878799150,13cyclictest30275-21ssh21:55:171
1878799150,10cyclictest16577-21ssh22:40:451
1878299156,7cyclictest7006-21sh21:42:450
1878299156,7cyclictest31545-21sh00:19:400
1878299156,7cyclictest30974-21sh00:36:330
1878299156,7cyclictest18070-21sshd21:49:060
1878299156,7cyclictest13087-21grep23:15:150
1878299154,8cyclictest22639-21vmstat21:15:280
1878299152,10cyclictest780-21runrttasks19:39:050
18782991511,3cyclictest32697-21sh22:14:590
1878299151,10cyclictest3655-21sh23:27:530
1878299150,9cyclictest31792-21sh00:01:010
1207899150,8tDemoTimingTask17816-21turbostat00:30:005
780399140,11tDemoTimingTask15745-21chrt00:10:205
359739140,8EcMasterDemoSyn4434-21taskset22:34:555
3047629140,8tAtEmLog_030083-21sleep23:29:555
2213299141,10tDemoTimingTask26298-21taskset22:10:325
1880299143,8cyclictest12481-21xargs21:45:254
1880299142,8cyclictest29161-21ssh21:36:564
1880299141,9cyclictest21898-21runintdemo5min20:22:344
1880299140,9cyclictest1816-21/usr/sbin/munin20:50:134
1880299140,9cyclictest14522-21/usr/sbin/munin00:10:144
1880299140,9cyclictest11025-21ssh00:07:544
1880299140,8cyclictest10945-21diskmemload21:32:374
1880299140,12cyclictest286-1jbd2/md0-821:51:494
1880299140,10cyclictest4809-21sh23:10:194
1880299140,10cyclictest4577-21ssh23:45:584
1880299140,10cyclictest31271-21sh00:19:284
1880299140,10cyclictest28769-21rm23:41:304
1880299140,10cyclictest26791-21latency_hist20:35:004
1880299140,10cyclictest19241-21ssh22:06:584
1880299140,10cyclictest18880-21ssh23:54:444
1879699144,4cyclictest28655-21timerwakeupswit20:35:223
1879699143,8cyclictest6145-21wc22:35:183
1879699143,7cyclictest14860-21kworker/u24:4+nfsiod23:35:033
1879699141,9cyclictest780-21runrttasks22:51:503
1879699141,9cyclictest6050-21/usr/sbin/munin22:00:143
1879699141,9cyclictest31774-21latency_hist20:45:003
1879699141,9cyclictest19567-21ssh23:55:023
1879699141,10cyclictest19513-21sh23:00:253
1879699141,10cyclictest13890-21ssh21:46:113
18796991410,3cyclictest14781-21cpuspeed_turbos00:10:143
1879699140,10cyclictest9724-21rm23:13:243
1879699140,10cyclictest8488-21runrttasks21:03:413
1879699140,10cyclictest8172-21cut19:55:013
1879699140,10cyclictest780-21runrttasks22:55:503
1879699140,10cyclictest716-21snmpd22:46:313
1879699140,10cyclictest716-21snmpd20:15:013
1879699140,10cyclictest6491-21ssh21:25:093
1879699140,10cyclictest5016-21ssh22:16:593
1879699140,10cyclictest3855-21runrttasks20:54:593
1879699140,10cyclictest30803-21sh22:13:433
1879699140,10cyclictest30670-21/usr/sbin/munin23:25:143
1879699140,10cyclictest29797-21ssh21:20:093
1879699140,10cyclictest28540-21/usr/sbin/munin19:30:203
1879699140,10cyclictest28366-21ssh22:30:083
1879699140,10cyclictest27426-21ssh21:35:423
1879699140,10cyclictest25665-21chrt19:22:543
1879699140,10cyclictest24471-21wc00:15:163
1879699140,10cyclictest24236-21sh21:16:343
1879699140,10cyclictest22721-21sh21:51:013
1879699140,10cyclictest21849-21cpuspeed23:20:123
1879699140,10cyclictest21640-21sh22:25:413
1879699140,10cyclictest20035-21/usr/sbin/munin20:20:193
1879699140,10cyclictest18256-21ssh22:06:163
1879699140,10cyclictest17991-21ssh23:54:073
1879699140,10cyclictest1730-21/usr/sbin/munin21:40:223
1879699140,10cyclictest1714-21sh00:38:473
1879699140,10cyclictest17053-21chrt00:29:283
1879699140,10cyclictest15944-21/usr/sbin/munin21:30:203
1879699140,10cyclictest15293-21chrt20:10:103
1879699140,10cyclictest15270-21missed_timers22:40:183
1879699140,10cyclictest13445-21fschecks_time20:05:163
1879699140,10cyclictest12342-21sh22:20:293
1879699140,10cyclictest11395-21ssh21:10:063
1879699140,10cyclictest10844-21ssh23:31:353
1879199145,7cyclictest25824-21cut23:40:152
1879199143,8cyclictest1136-21packagekitd19:45:062
1879199141,9cyclictest7423-21missed_timers21:00:192
1879199141,9cyclictest3607-21/usr/sbin/munin23:10:112
1879199141,9cyclictest19705-21ssh21:50:032
1879199141,9cyclictest10255-21sh22:37:422
1879199141,9cyclictest10244-21/usr/sbin/munin22:20:202
1879199141,10cyclictest24324-21runrttasks20:28:372
1879199140,9cyclictest780-21runrttasks19:30:102
1879199140,10cyclictest9886-21ssh00:25:142
1879199140,10cyclictest9607-21sh21:26:122
1879199140,10cyclictest9221-21sh21:44:162
1879199140,10cyclictest8908-21/usr/sbin/munin22:55:192
1879199140,10cyclictest849-21rm00:20:172
1879199140,10cyclictest780-21runrttasks20:09:182
1879199140,10cyclictest780-21runrttasks00:33:132
1879199140,10cyclictest716-21snmpd20:01:462
1879199140,10cyclictest6633-21/usr/sbin/munin19:50:172
1879199140,10cyclictest534-21ssh22:15:002
1879199140,10cyclictest3893-21runrttasks21:23:322
1879199140,10cyclictest3305-21sh22:51:292
1879199140,10cyclictest32627-21irqstats20:45:172
1879199140,10cyclictest315-21chrt19:37:562
1879199140,10cyclictest30833-21switchtime20:40:222
1879199140,10cyclictest30304-21ssh21:37:442
1879199140,10cyclictest30155-21/usr/sbin/munin00:00:182
1879199140,10cyclictest30055-21rm00:35:552
1879199140,10cyclictest27179-21grep23:05:132
1879199140,10cyclictest24050-21ssh23:57:022
1879199140,10cyclictest23778-21/usr/sbin/munin19:20:172
1879199140,10cyclictest21960-21runrttasks20:23:252
1879199140,10cyclictest2082-21missed_timers19:40:172
1879199140,10cyclictest20536-21sh21:32:162
1879199140,10cyclictest20410-21ssh21:15:022
1879199140,10cyclictest20243-21uname22:25:172
1879199140,10cyclictest19255-21ssh00:12:222
1879199140,10cyclictest18532-21ssh23:35:402
1879199140,10cyclictest17995-21df20:15:132
1879199140,10cyclictest17964-21/usr/sbin/munin23:00:152
1879199140,10cyclictest16980-21chrt20:10:502
1879199140,10cyclictest1616-21ssh23:45:022
1879199140,10cyclictest15195-21missed_timers22:40:182
1879199140,10cyclictest15125-21/usr/sbin/munin22:05:262
1879199140,10cyclictest13794-21ntp_kernel_err23:15:192
1879199140,10cyclictest10858-21rm21:45:122
1878799143,8cyclictest30085-21unixbench_multi19:30:251
1878799143,6cyclictest23844-21fw_packets22:45:161
1878799143,4cyclictest32-21ksoftirqd/121:35:201
1878799142,8cyclictest31117-21open_inodes21:20:191
1878799141,9cyclictest23459-21ssh00:15:081
1878799141,9cyclictest18838-21forks00:30:141
1878799141,9cyclictest14780-21chrt22:22:131
1878799141,10cyclictest16-1pr/legacy00:00:321
1878799140,9cyclictest1905-21missed_timers22:15:161
1878799140,10cyclictest716-21snmpd00:25:121
1878799140,10cyclictest6591-21fschecks_time22:00:151
1878799140,10cyclictest536-21latency_hist19:40:001
1878799140,10cyclictest4745-21sh21:41:101
1878799140,10cyclictest32600-21/usr/sbin/munin00:20:141
1878799140,10cyclictest32099-21sh22:31:371
1878799140,10cyclictest31861-21chrt20:45:021
1878799140,10cyclictest29415-21ssh22:12:421
1878799140,10cyclictest28484-21ssh21:19:271
1878799140,10cyclictest28087-21taskset19:28:061
1878799140,10cyclictest2806-21sh22:51:061
1878799140,10cyclictest26631-21ssh23:58:531
1878799140,10cyclictest24896-21ps19:20:191
1878799140,10cyclictest24865-21ssh21:52:321
1878799140,10cyclictest20035-21/usr/sbin/munin20:20:251
1878799140,10cyclictest19818-21latency_hist20:20:001
1878799140,10cyclictest1973-21ssh00:38:581
1878799140,10cyclictest18415-21ssh22:06:241
1878799140,10cyclictest15015-21ssh23:15:461
1878799140,10cyclictest14429-21ssh21:29:341
1878799140,10cyclictest13913-21ssh21:10:441
1878299145,7cyclictest7851-21ps21:25:210
1878299145,7cyclictest24928-21sh21:35:070
1878299142,9cyclictest29879-21df_inode20:40:130
1878299141,9cyclictest780-21runrttasks19:51:050
1878299141,9cyclictest23379-21sh23:56:330
1878299141,11cyclictest3329-21cat19:45:010
1878299141,10cyclictest14246-21sh22:21:510
1878299140,9cyclictest18064-21sh23:54:110
1878299140,6cyclictest5760-21cut22:35:150
1878299140,6cyclictest30613-21awk19:35:000
1878299140,12cyclictest31816-21sh21:20:250
1878299140,12cyclictest29959-21sh22:30:240
1878299140,12cyclictest25491-21sh22:45:410
1878299140,12cyclictest22554-21sh21:50:540
1878299140,12cyclictest19838-21sensors_volt00:30:210
1878299140,10cyclictest4746-21gltestperf20:55:150
1878299140,10cyclictest326-21systemd-journal20:36:010
1878299140,10cyclictest28055-21runrttasks19:27:400
1878299140,10cyclictest20332-21latency22:25:170
1878299140,10cyclictest19743-21sh23:36:310
1878299140,10cyclictest14244-21sh00:10:000
1878299140,10cyclictest13274-21sh22:04:060
1878299140,10cyclictest10859-21ssh00:25:190
1475929140,6tAtEmLog_017089-21taskset20:12:175
3137499130,11tDemoTimingTask31547-21chrt20:44:495
1880299139,3cyclictest811-21runintdemo5min23:25:074
1880299139,3cyclictest17445-21ntp_kernel_pll_23:35:184
1880299135,6cyclictest21187-21fschecks_count21:15:154
1880299132,8cyclictest23409-21netstat20:25:184
1880299131,9cyclictest25326-21unixbench_multi19:20:244
1880299131,9cyclictest1611-21runrttasks21:40:064
1880299131,9cyclictest11447-21ssh21:10:094
1880299130,9cyclictest8783-21rm22:55:064
1880299130,9cyclictest8218-21/usr/sbin/munin19:55:244
1880299130,9cyclictest817-21/usr/sbin/munin22:15:184
1880299130,9cyclictest7863-21sh22:54:414
1880299130,9cyclictest780-21runrttasks22:00:104
1880299130,9cyclictest6528-21date21:00:004
1880299130,9cyclictest4726-21sendmail_mailtr19:45:214
1880299130,9cyclictest4169-21/usr/sbin/munin20:55:194
1880299130,9cyclictest31874-21/usr/sbin/munin20:45:154
1880299130,9cyclictest31631-21cat21:20:244
1880299130,9cyclictest31259-21diskstats19:35:154
1880299130,9cyclictest29327-21/usr/sbin/munin21:55:164
1880299130,9cyclictest27144-21/usr/sbin/munin20:35:114
1880299130,9cyclictest27106-21ssh00:35:014
1880299130,9cyclictest25425-21ssh22:10:204
1880299130,9cyclictest21629-21/usr/sbin/munin23:20:194
1880299130,9cyclictest21404-21/usr/sbin/munin19:15:144
1880299130,9cyclictest21404-21/usr/sbin/munin19:15:144
1880299130,9cyclictest19413-21diskstats19:10:154
1880299130,9cyclictest19324-21runrttasks20:15:364
1880299130,9cyclictest1394-21awk00:20:194
1880299130,9cyclictest13082-21fschecks_count23:15:144
1880299130,9cyclictest1307-21ssh23:08:474
1880299130,9cyclictest12748-21sh22:20:464
1880299130,9cyclictest10594-21/usr/sbin/munin20:00:194
1880299130,10cyclictest7102-21sh23:30:074
1880299130,10cyclictest31281-21ssh00:00:404
1880299130,10cyclictest27882-21ssh22:47:194
1880299130,10cyclictest21784-21ssh23:55:274
1880299130,10cyclictest20864-21sh22:25:244
1880299130,10cyclictest1159-21/usr/sbin/munin19:40:124
1880299130,10cyclictest10858-21runrttasks21:08:594
1879699135,6cyclictest9687-21cat19:55:243
1879699135,6cyclictest4496-21expr20:55:133
1879699130,9cyclictest716-21snmpd19:35:073
1879699130,9cyclictest583-21/usr/sbin/munin00:20:153
1879699130,9cyclictest3640-21cpu19:45:133
1879699130,9cyclictest27020-21/usr/sbin/munin23:05:193
1879699130,9cyclictest22386-21/usr/sbin/munin20:25:123
1879699130,9cyclictest20909-21runrttasks19:12:303
1879699130,9cyclictest1159-21/usr/sbin/munin19:40:123
1879699130,11cyclictest10315-21cat21:05:243
1879699130,10cyclictest27991-21runrttasks19:26:503
1879699130,10cyclictest14341-21sed23:15:243
1879699130,10cyclictest10978-21uniq20:00:163
1879199130,9cyclictest780-21runrttasks19:26:572
1879199130,9cyclictest29728-21ssh21:55:132
1879199130,9cyclictest27522-21awk20:35:142
1879199130,10cyclictest780-21runrttasks19:59:302
1879199130,10cyclictest5009-21cat20:55:172
1879199130,10cyclictest3210-21timerandwakeup20:50:232
1879199130,10cyclictest25645-21sed20:30:172
1879199130,10cyclictest23109-21ssh22:45:082
1879199130,10cyclictest21009-21runrttasks19:13:532
1879199130,10cyclictest10642-21runrttasks21:06:412
1878799131,9cyclictest16-1pr/legacy23:25:031
1878799130,9cyclictest8729-21sh22:36:371
1878799130,9cyclictest8673-21sh22:55:011
1878799130,9cyclictest780-21runrttasks19:47:391
1878799130,9cyclictest7082-21fschecks_time21:00:161
1878799130,9cyclictest29520-21/usr/sbin/munin20:40:131
1878799130,9cyclictest21035-21taskset19:14:131
1878799130,9cyclictest14964-21taskset20:09:431
1878799130,10cyclictest716-21snmpd23:05:161
1878799130,10cyclictest2350-21fschecks_time20:50:141
1878799130,10cyclictest22768-21grep19:15:251
1878799130,10cyclictest22768-21grep19:15:251
1878799130,10cyclictest21500-21ssh23:37:461
1878799130,10cyclictest19815-21tail23:00:271
1878799130,10cyclictest16909-21unixbench_singl20:10:241
1878799130,10cyclictest15829-21rm21:30:071
1878299135,6cyclictest326-21systemd-journal20:19:370
1878299133,8cyclictest30014-21expr21:55:140
1878299130,9cyclictest780-21runrttasks20:21:190
1878299130,9cyclictest780-21runrttasks20:04:040
1878299130,9cyclictest780-21runrttasks19:55:240
1878299130,9cyclictest32093-21cpuspeed_turbos20:45:150
1878299130,9cyclictest25714-21chrt19:23:330
1878299130,9cyclictest24029-21vmstat20:25:240
1878299130,9cyclictest22464-21ntpq19:15:200
1878299130,9cyclictest22464-21ntpq19:15:200
1878299130,9cyclictest19776-21/usr/sbin/munin19:10:170
1878299130,9cyclictest15764-21fw_packets22:05:170
1878299130,9cyclictest15651-21df_inode20:10:130
1878299130,9cyclictest14774-21runintdemo5min20:07:200
1878299130,9cyclictest10891-21taskset21:09:230
1878299130,7cyclictest174-1kworker/0:1H+kblockd20:54:320
1878299130,11cyclictest25611-21/usr/sbin/munin20:30:170
1878299130,10cyclictest7099-21fschecks_time21:00:150
1279699130,11tDemoTimingTask13674-21chrt21:29:015
809899121,9tDemoTimingTask13451-21chrt22:21:165
3113129125,0tAtEmLog_00-21swapper/500:00:405
2421139120,0EcMasterDemoSyn0-21swapper/520:27:355
1880299120,9cyclictest780-21runrttasks20:05:314
1880299120,9cyclictest6404-21grep19:50:154
1880299120,9cyclictest27928-21runrttasks19:26:384
1879699120,9cyclictest31913-21aten2_r5power_e20:45:133
1878799120,9cyclictest27141-21runrttasks20:35:081
1878799120,9cyclictest11080-21fschecks_time20:00:171
1878299121,6cyclictest18812-21cat19:10:000
1658729120,1tAtEmLog_0249862sleep523:40:035
1240299120,10tDemoTimingTask12455-21taskset20:02:355
1076139120,0EcMasterDemoSyn0-21swapper/521:08:105
3267699110,9tDemoTimingTask32729-21chrt19:37:115
3267699110,9tDemoTimingTask2888-21chrt19:41:235
326239110,0EcMasterDemoSyn0-21swapper/523:45:215
2898239110,0EcMasterDemoSyn0-21swapper/520:37:435
283439110,0EcMasterDemoSyn0-21swapper/523:09:525
2794639110,0EcMasterDemoSyn0-21swapper/519:26:445
2676239110,0EcMasterDemoSyn0-21swapper/522:29:185
2656939110,0EcMasterDemoSyn0-21swapper/520:32:395
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional