You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-04-10 - 12:01
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.

Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Characteristics of the 376 highest latencies:
System rack5slot1.osadl.org (updated Fri Apr 10, 2026 00:44:04)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
3164239930,0EcMasterDemoSyn3165229tAtEmLog_000:13:175
2488439910,0EcMasterDemoSyn2489429tAtEmLog_021:46:135
2367839850,0EcMasterDemoSyn2368829tAtEmLog_023:32:435
329639830,0EcMasterDemoSyn330629tAtEmLog_020:30:095
2085339830,0EcMasterDemoSyn2086329tAtEmLog_019:59:445
203139830,0EcMasterDemoSyn204129tAtEmLog_021:15:485
904739820,0EcMasterDemoSyn905729tAtEmLog_019:34:235
39739820,0EcMasterDemoSyn40729tAtEmLog_023:37:475
2794739820,0EcMasterDemoSyn2795729tAtEmLog_020:14:575
2794739820,0EcMasterDemoSyn2795729tAtEmLog_020:14:575
1735339820,0EcMasterDemoSyn1736329tAtEmLog_000:23:255
1528739820,0EcMasterDemoSyn1529729tAtEmLog_022:52:095
825939800,0EcMasterDemoSyn826929tAtEmLog_000:18:225
2558939800,0EcMasterDemoSyn2559929tAtEmLog_020:09:525
2323139620,0EcMasterDemoSyn0-21swapper/020:04:480
427539600,0EcMasterDemoSyn0-21swapper/223:58:052
29748992211,6cyclictest10140-21cut23:25:154
2644699190,16tDemoTimingTask27264-21chrt00:29:045
29747991814,3cyclictest646-21systemd-logind22:40:013
2974799180,11cyclictest6591-21runrttasks19:28:093
2974399181,13cyclictest16-1pr/legacy21:41:081
2973899185,9cyclictest19045-21sh22:00:500
2973899180,9cyclictest31753-21sh23:19:430
2973899180,10cyclictest7291-21sh21:55:050
2973899180,10cyclictest29753-21sh23:54:310
2973899180,10cyclictest23517-21sh00:08:530
2973899180,10cyclictest16047-21sh23:46:070
2759199180,8tDemoTimingTask32425-21chrt23:55:215
669699170,7tDemoTimingTask6753-21chrt19:29:435
29748991710,6cyclictest20452-21tr00:25:144
2974899170,9cyclictest14054-21rm21:22:484
2974899170,12cyclictest7013-21rm21:36:254
2974699179,6cyclictest13388-21grep19:40:232
29743991713,3cyclictest17908-21turbostat23:30:001
2973899175,9cyclictest14843-21sh21:23:210
2973899174,9cyclictest1006-21fschecks_time23:20:140
2973899170,9cyclictest9725-21sh22:14:040
2973899170,9cyclictest780-21runrttasks20:29:330
2973899170,9cyclictest28064-21sh21:48:280
2973899170,14cyclictest5525-21sh23:05:050
2759199170,7tDemoTimingTask29913-21taskset23:54:395
195529170,7tAtEmLog_04216-21chrt19:22:535
1912639170,10EcMasterDemoSyn19785-21chrt21:05:015
1849639170,0EcMasterDemoSyn0-21swapper/519:54:405
2974899169,5cyclictest8478-21tune2fs20:40:144
2974799168,6cyclictest20332-21head23:30:243
2974699168,6cyclictest4446-21grep22:10:242
2974699167,5cyclictest711-21gdbus20:20:002
2974699166,5cyclictest21518-21/usr/sbin/munin00:25:202
2974699164,7cyclictest22777-21grep21:10:152
2974699160,9cyclictest15781-21diskmemload22:16:572
2973899163,10cyclictest17976-21sh00:23:510
2973899160,9cyclictest15866-21taskset19:46:010
2973899160,8cyclictest30346-21sh00:12:220
2973899160,8cyclictest27162-21sed22:05:240
2973899160,8cyclictest27162-21sed22:05:240
2973899160,7cyclictest20251-21cat22:20:000
2973899160,6cyclictest15583-21ssh23:28:220
2973899160,13cyclictest10319-21cron22:50:000
2973899160,10cyclictest9651-21ssh00:00:260
2973899160,10cyclictest21018-21rm23:30:510
2973899160,10cyclictest11681-21sh00:38:170
650129150,8tAtEmLog_012427-21taskset21:40:005
2974799152,9cyclictest908-21ssh00:14:283
29747991511,3cyclictest30291-21turbostat21:50:003
2974799151,11cyclictest16-1pr/legacy19:59:433
2974799151,10cyclictest2540-21ssh21:51:573
2974799151,10cyclictest14169-21runrttasks21:58:463
2974799150,9cyclictest9404-21/usr/sbin/munin23:25:123
2974799150,9cyclictest8344-21users22:30:253
2974799150,9cyclictest11825-21sshd21:21:143
2974799150,7cyclictest18170-21diskstats21:25:143
2974799150,10cyclictest2955-21ssh21:16:253
2974699159,2cyclictest171rcu_preempt23:38:382
2974699154,8cyclictest6421-21basename00:35:152
2974699151,6cyclictest19564-21ssh00:06:052
29746991511,3cyclictest699-21polkitd00:10:212
2974699151,10cyclictest9895-21ssh22:31:302
2974699151,10cyclictest26521-21sh22:58:402
2974699151,10cyclictest22606-21cat20:00:232
2974699151,10cyclictest16571-21sh21:24:342
2974699150,9cyclictest41-21ksoftirqd/223:05:172
2974699150,9cyclictest3211-21sh21:16:362
2974699150,9cyclictest22408-21sh22:38:542
2974699150,11cyclictest3672-21ssh22:28:272
2974699150,10cyclictest7818-21ssh21:37:002
2974699150,10cyclictest30871-21basename21:50:112
2974699150,10cyclictest27580-21sh21:48:062
2974699150,10cyclictest16346-21sh22:52:532
2974699150,10cyclictest13344-21/usr/sbin/munin21:40:152
2974399155,6cyclictest23280-21kworker/u24:5+xprtiod23:30:341
2974399155,6cyclictest16210-21cat00:05:001
2974399155,5cyclictest22706-21kworker/u24:0+xprtiod23:54:351
2974399154,8cyclictest716-21snmpd20:50:391
2974399154,7cyclictest27106-21kworker/u24:3+xprtiod22:05:021
2974399154,7cyclictest27106-21kworker/u24:3+xprtiod22:05:021
2974399151,9cyclictest780-21runrttasks21:24:281
29743991511,3cyclictest648-21dbus-daemon19:30:001
29743991511,3cyclictest20979-21needreboot22:55:161
2974399151,10cyclictest2254-21/usr/sbin/munin00:15:181
2974399150,9cyclictest10105-21ssh21:38:361
2974399150,8cyclictest4467-21/usr/sbin/munin22:10:241
2974399150,8cyclictest18353-21runrttasks19:52:511
2974399150,11cyclictest6959-21ssh23:41:061
2974399150,10cyclictest23596-21ssh00:26:281
2974399150,10cyclictest13829-21runrttasks19:44:381
2973899159,5cyclictest9246-21grep20:40:180
2973899156,7cyclictest463-21sh23:01:470
2973899156,7cyclictest31771-21if_enp6s023:55:150
2973899156,7cyclictest31717-21sh22:25:270
2973899154,8cyclictest326-21systemd-journal21:05:000
2973899150,9cyclictest23961-21ssh21:10:240
2973899150,8cyclictest174-1kworker/0:1H+kblockd20:57:350
2973899150,5cyclictest14092-21latency_hist19:45:000
2973899150,12cyclictest13215-21diskmemload22:33:480
2974899149,3cyclictest15708-21sed20:55:154
2974899146,6cyclictest6223-21tune2fs20:35:154
2974899146,4cyclictest5266-21kworker/u24:0+nfsiod21:13:204
2974899145,7cyclictest23620-21hostname20:05:094
2974899144,6cyclictest5064-21cstates19:25:124
2974899143,8cyclictest15985-21processes23:10:194
2974899143,6cyclictest17135-21cut00:05:134
2974899143,6cyclictest10868-21kworker/u24:2+rpciod21:50:264
2974899142,8cyclictest19439-21load23:30:164
2974899141,9cyclictest7246-21if_err_enp6s022:30:164
2974899141,9cyclictest25641-21/usr/sbin/munin00:10:134
2974899141,9cyclictest12407-21taskset20:49:564
29748991412,2cyclictest3428-21kworker/4:1+events22:11:344
29748991411,2cyclictest0-21swapper/423:50:014
2974899141,10cyclictest30136-21memory00:30:174
2974899141,10cyclictest25038-21runrttasks22:22:064
2974899141,10cyclictest11733-21runrttasks23:08:194
2974899140,9cyclictest19966-21runintdemo5min22:01:284
2974899140,7cyclictest907050cat23:25:014
2974899140,11cyclictest23749-21rm22:56:444
2974899140,10cyclictest780-21runrttasks22:40:284
2974899140,10cyclictest4194-21/usr/sbin/munin23:40:184
2974899140,10cyclictest3329-21/usr/sbin/munin20:30:124
2974899140,10cyclictest32260-21latency_hist19:15:004
2974899140,10cyclictest3197-21ssh21:16:354
2974899140,10cyclictest30474-21sh23:00:214
2974899140,10cyclictest30410-21ssh23:36:054
2974899140,10cyclictest29931-21ssh21:49:454
2974899140,10cyclictest22133-21/usr/sbin/munin23:50:204
2974899140,10cyclictest21508-21sh22:38:164
2974899140,10cyclictest20926-21idleruntime-cro20:00:004
2974899140,10cyclictest15226-21ssh22:16:354
2974899140,10cyclictest12848-21ssh21:57:504
2974899140,10cyclictest12421-21sh00:20:204
2974899140,10cyclictest1134-21rm22:09:364
2974899140,10cyclictest1134-21rm22:09:364
2974899140,10cyclictest10556-21rm00:19:584
2974799144,5cyclictest27946-21fschecks_count23:35:143
2974799141,9cyclictest6870-21ssh21:36:193
2974799141,9cyclictest31360-21runrttasks00:30:363
2974799141,10cyclictest6485-21runrttasks23:40:443
2974799141,10cyclictest5710-21/usr/sbin/munin20:35:123
2974799141,10cyclictest2872-21ssh21:34:543
2974799141,10cyclictest2816-21runrttasks20:27:483
2974799141,10cyclictest26377-21ssh22:23:023
2974799141,10cyclictest23027-21ssh22:56:143
2974799140,9cyclictest716-21snmpd19:43:233
2974799140,9cyclictest26176-21fschecks_time22:05:153
2974799140,9cyclictest26176-21fschecks_time22:05:153
2974799140,9cyclictest12737-21aten2_r5power_c20:50:123
2974799140,8cyclictest19585-21ps22:36:563
2974799140,10cyclictest9442-21/usr/sbin/munin19:35:153
2974799140,10cyclictest780-21runrttasks23:51:043
2974799140,10cyclictest780-21runrttasks19:33:473
2974799140,10cyclictest780-21runrttasks00:38:083
2974799140,10cyclictest5285-21ssh22:46:283
2974799140,10cyclictest4622-21ssh22:10:303
2974799140,10cyclictest318-21/usr/sbin/munin23:20:183
2974799140,10cyclictest31280-21sh22:25:233
2974799140,10cyclictest30945-21sh23:00:253
2974799140,10cyclictest30561-21latency_hist20:20:013
2974799140,10cyclictest30003-21/usr/sbin/munin19:10:183
2974799140,10cyclictest23718-21apt-get23:15:123
2974799140,10cyclictest23591-21/usr/sbin/munin20:05:113
2974799140,10cyclictest22788-21ssh00:25:553
2974799140,10cyclictest2254-21/usr/sbin/munin00:15:153
2974799140,10cyclictest22457-21/usr/sbin/munin21:10:243
2974799140,10cyclictest20066-21sh22:01:323
2974799140,10cyclictest19797-21/usr/sbin/munin21:05:193
2974799140,10cyclictest19706-21ssh00:06:113
2974799140,10cyclictest17898-21sh23:11:193
2974799140,10cyclictest16518-21/usr/sbin/munin19:50:123
2974799140,10cyclictest16497-21ssh22:52:593
2974799140,10cyclictest16011-21sh00:22:283
2974799140,10cyclictest15325-21runrttasks21:40:543
2974799140,10cyclictest15074-21/usr/sbin/munin20:55:133
2974799140,10cyclictest14838-21hddtemp_smartct19:45:163
2974799140,10cyclictest13721-21ssh22:15:313
2974799140,10cyclictest12956-21sh23:45:063
2974799140,10cyclictest11931-21ssh00:02:043
2974799140,10cyclictest10720-21sshd20:45:133
2974799140,10cyclictest10021-21ssh23:07:083
2974699147,3cyclictest1912639EcMasterDemoSyn21:00:352
2974699143,8cyclictest728-21lldpd20:05:382
2974699143,7cyclictest30122-21grep23:00:172
2974699143,5cyclictest22057-21kworker/u24:0+xprtiod21:33:092
2974699141,9cyclictest5645-21/usr/sbin/munin20:35:182
2974699141,10cyclictest19728-21sh21:25:262
2974699141,10cyclictest1873-21ssh22:45:122
2974699140,8cyclictest17047-21fschecks_count22:00:152
2974699140,10cyclictest780-21runrttasks20:41:012
2974699140,10cyclictest4162-21ssh23:40:102
2974699140,10cyclictest3633-21python319:20:212
2974699140,10cyclictest326-21systemd-journal19:55:052
2974699140,10cyclictest32503-21ssh23:20:012
2974699140,10cyclictest31630-21ssh00:30:482
2974699140,10cyclictest3074-21/usr/sbin/munin00:15:172
2974699140,10cyclictest28465-21ssh22:41:362
2974699140,10cyclictest28157-21rm22:05:532
2974699140,10cyclictest28157-21rm22:05:532
2974699140,10cyclictest27264-21ssh23:16:342
2974699140,10cyclictest26518-21perl20:10:132
2974699140,10cyclictest26518-21perl20:10:132
2974699140,10cyclictest22133-21/usr/sbin/munin23:50:132
2974699140,10cyclictest21853-21idleruntime-cro21:10:002
2974699140,10cyclictest20700-21/usr/sbin/munin22:20:132
2974699140,10cyclictest18426-21/usr/sbin/munin23:30:122
2974699140,10cyclictest15642-21sed23:10:172
2974699140,10cyclictest14169-21/usr/sbin/munin19:45:182
2974699140,10cyclictest13508-21sh00:20:412
2974699140,10cyclictest13007-21ssh23:26:352
2974699140,10cyclictest12972-21ssh00:02:492
2974699140,10cyclictest12925-21ssh23:45:042
2974699140,10cyclictest12721-21/usr/sbin/munin20:50:172
2974699140,10cyclictest11038-21hddtemp_smartct20:45:152
2974699140,10cyclictest10551-21sh21:56:152
2974399144,8cyclictest18328-21grep22:00:281
2974399141,9cyclictest780-21runrttasks21:49:221
2974399141,9cyclictest744-21postgres20:22:321
2974399141,9cyclictest23706-21/usr/sbin/munin23:15:201
29743991410,3cyclictest645-21avahi-daemon22:40:411
29743991410,3cyclictest19490-21gltestperf19:55:161
2974399140,9cyclictest3302-21runintdemo5min20:30:091
2974399140,9cyclictest19084-21processes21:25:201
2974399140,9cyclictest15902-21runrttasks19:46:301
2974399140,12cyclictest900-21fschecks_time23:20:141
2974399140,12cyclictest29773-21taskset22:25:121
2974399140,11cyclictest30226-21ssh23:35:571
2974399140,11cyclictest18056-21rm23:11:261
2974399140,10cyclictest986-21/usr/sbin/munin20:25:221
2974399140,10cyclictest9332-21ssh22:31:061
2974399140,10cyclictest9017-21taskset19:34:071
2974399140,10cyclictest6986-21processes00:35:181
2974399140,10cyclictest635-21ssh23:55:311
2974399140,10cyclictest5449-21ssh22:46:351
2974399140,10cyclictest32652-21sh00:13:581
2974399140,10cyclictest31903-21ssh00:31:001
2974399140,10cyclictest30170-21chrt20:18:101
2974399140,10cyclictest29621-21ssh23:00:141
2974399140,10cyclictest26713-21ssh21:12:011
2974399140,10cyclictest25945-21/usr/sbin/munin20:10:101
2974399140,10cyclictest25945-21/usr/sbin/munin20:10:101
2974399140,10cyclictest25356-21ssh22:22:191
2974399140,10cyclictest2460-21rm21:16:041
2974399140,10cyclictest21585-21/usr/sbin/munin20:00:131
2974399140,10cyclictest19762-21ssh00:06:141
2974399140,10cyclictest18532-21ssh00:24:141
2974399140,10cyclictest17531-21ssh22:35:311
2974399140,10cyclictest17240-21sh22:17:591
2974399140,10cyclictest13747-21fschecks_time23:45:151
2974399140,10cyclictest13427-21sh21:58:141
2974399140,10cyclictest11457-21ssh23:08:061
2974399140,10cyclictest10868-21/usr/sbin/munin22:50:121
2973899146,6cyclictest14601-21grep21:40:240
2973899146,6cyclictest11279-21df_inode22:50:130
2973899145,7cyclictest16051-21cut23:10:190
2973899141,9cyclictest780-21runrttasks20:31:180
2973899141,9cyclictest12134-21runrttasks20:46:140
2973899141,7cyclictest174-1kworker/0:1H+kblockd19:12:100
2973899141,3cyclictest18508-21hddtemp_smartct21:25:150
2973899141,11cyclictest20280-21aten2_r5power_p00:25:130
2973899140,9cyclictest780-21runrttasks19:25:590
2973899140,9cyclictest20834-21cpu22:20:140
2973899140,7cyclictest6038-21users23:40:270
2973899140,7cyclictest31526-21sh00:30:430
2973899140,7cyclictest24799-21ssh22:40:100
2973899140,7cyclictest20697-21/usr/sbin/munin22:55:140
2973899140,12cyclictest5499-21sh21:35:240
2973899140,12cyclictest32673-21sed21:15:160
2973899140,12cyclictest31733-21cat21:50:160
2973899140,12cyclictest17066-21sed22:35:230
2973899140,11cyclictest31150-21ssh23:36:370
2973899140,10cyclictest4355-21wc19:24:160
2973899140,10cyclictest2050-21ssh00:15:030
2644699140,12tDemoTimingTask663-21chrt00:31:525
1959099140,7tDemoTimingTask21584-21taskset22:38:195
1675829140,6tAtEmLog_016937-21taskset20:57:355
911139130,0EcMasterDemoSyn0-21swapper/520:40:185
650299131,10tDemoTimingTask7544-21chrt21:36:485
2974899133,8cyclictest14113-21cat20:50:244
2974899131,9cyclictest2368-21runrttasks19:20:054
2974899131,8cyclictest14103-21mailstats21:40:204
2974899130,9cyclictest780-21runrttasks19:41:504
2974899130,9cyclictest7088-21/usr/sbin/munin19:30:134
2974899130,9cyclictest30893-21sh23:55:074
2974899130,9cyclictest29766-21/usr/sbin/munin22:25:194
2974899130,9cyclictest28024-21cat20:15:004
2974899130,9cyclictest28024-21cat20:14:594
2974899130,9cyclictest27824-21sh23:16:574
2974899130,9cyclictest19885-21wget21:05:114
2974899130,9cyclictest19289-21taskset21:02:174
2974899130,9cyclictest18003-21grep21:25:134
2974899130,9cyclictest16518-21/usr/sbin/munin19:50:154
2974899130,9cyclictest14506-21cstates19:45:134
2974899130,9cyclictest10746-21diskmemload22:50:064
2974899130,10cyclictest780-21runrttasks20:00:294
2974899130,10cyclictest7588-21sh00:00:074
2974899130,10cyclictest31190-21cut20:20:144
2974899130,10cyclictest3067-21ssh22:45:204
2974899130,10cyclictest29055-21irqstats20:15:174
2974899130,10cyclictest29054-21ssh21:30:354
2974899130,10cyclictest2834-21taskset20:28:044
2974899130,10cyclictest11191-21taskset19:36:434
2974899130,10cyclictest10833-21sh00:37:404
2974799131,9cyclictest21244-21/usr/sbin/munin20:00:123
2974799130,9cyclictest8012-21taskset20:40:073
2974799130,9cyclictest3432-21aten2_r5power_v20:30:133
2974799130,8cyclictest30791-21sh23:55:033
2974799130,8cyclictest1950-21runintdemo5min19:19:103
2974799130,10cyclictest31684-21needreboot20:20:173
2974799130,10cyclictest3135-21uname19:20:163
2974799130,10cyclictest27602-21taskset20:10:243
2974799130,10cyclictest27602-21taskset20:10:243
2974799130,10cyclictest17437-21taskset21:00:043
2974699130,9cyclictest9941-21fschecks_time19:35:152
2974699130,9cyclictest803-21latency19:15:162
2974699130,9cyclictest780-21runrttasks19:51:362
2974699130,9cyclictest642-21latency_hist20:25:012
2974699130,9cyclictest4015-21hddtemp_smartct20:30:162
2974699130,8cyclictest7323-21tr19:30:142
2974699130,8cyclictest15163-21wget20:55:122
2974699130,10cyclictest780-21runrttasks20:25:142
2974699130,10cyclictest6547-21runrttasks19:27:352
2974699130,10cyclictest31193-21plymouth19:10:192
2974399135,6cyclictest9994-21perl19:35:151
2974399135,6cyclictest2772-21cut19:20:141
2974399135,6cyclictest27608-21expr21:30:161
2974399132,8cyclictest12015-21sed20:45:251
2974399131,9cyclictest30003-21/usr/sbin/munin19:10:121
2974399130,9cyclictest716-21snmpd20:59:371
2974399130,9cyclictest5645-21/usr/sbin/munin20:35:161
2974399130,9cyclictest32355-21/usr/sbin/munin19:15:171
2974399130,9cyclictest30807-21/usr/sbin/munin21:50:161
2974399130,9cyclictest20177-21/usr/sbin/munin21:05:141
2974399130,9cyclictest17446-21/usr/sbin/munin21:00:181
2974399130,8cyclictest24247-21cut20:05:121
2974399130,10cyclictest8016-21/usr/sbin/munin20:40:181
2974399130,10cyclictest29690-21latency_hist19:10:001
2973899135,6cyclictest18932-21aten2_r5power_e19:55:120
2973899135,6cyclictest18848-21latency_hist19:55:010
2973899131,9cyclictest811-21runintdemo5min20:09:510
2973899131,9cyclictest29745-21timerwakeupswit20:15:240
2973899130,9cyclictest780-21runrttasks20:37:130
2973899130,9cyclictest780-21runrttasks20:10:140
2973899130,9cyclictest780-21runrttasks20:10:140
2973899130,9cyclictest31762-21open_files20:20:190
2973899130,9cyclictest28074-21netstat21:30:190
2973899130,9cyclictest13391-21hddtemp_smartct20:50:160
2973899130,7cyclictest7088-21/usr/sbin/munin19:30:130
2973899130,10cyclictest17523-21aten2_r5power_p21:00:120
2973899130,10cyclictest10901-21cat19:35:240
2722199130,11tDemoTimingTask29323-21chrt19:05:505
1165099130,11tDemoTimingTask12327-21chrt20:48:525
81192120,0sleep50-21swapper/522:48:275
2974899124,6cyclictest29830-21date19:09:594
2974899120,9cyclictest32354-21runrttasks19:15:114
2974799120,9cyclictest29923-21latency_hist19:10:003
2973899124,6cyclictest29891-21latency_hist19:10:000
2973899120,9cyclictest870-21/usr/sbin/munin19:15:170
946639110,0EcMasterDemoSyn0-21swapper/523:42:515
602039110,0EcMasterDemoSyn0-21swapper/520:35:145
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional