You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-07-07 - 08:26
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.

Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Characteristics of the 376 highest latencies:
System rack5slot1.osadl.org (updated Tue Jul 07, 2026 00:44:04)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
2560539880,0EcMasterDemoSyn25614-21runintdemo5min19:45:311
2652939850,1EcMasterDemoSyn2653929tAtEmLog_023:48:555
1271039830,0EcMasterDemoSyn1272029tAtEmLog_020:26:055
1209839830,0EcMasterDemoSyn1210829tAtEmLog_019:20:095
844839820,0EcMasterDemoSyn845829tAtEmLog_023:38:465
311739820,0EcMasterDemoSyn312729tAtEmLog_023:53:595
2319239820,0EcMasterDemoSyn2320229tAtEmLog_019:40:275
1096739820,0EcMasterDemoSyn1097729tAtEmLog_022:27:475
678039810,0EcMasterDemoSyn679029tAtEmLog_000:14:165
1521439810,0EcMasterDemoSyn1522429tAtEmLog_022:48:045
1506939810,0EcMasterDemoSyn1507929tAtEmLog_020:31:095
1035339810,0EcMasterDemoSyn1036329tAtEmLog_020:21:015
3185739210,0EcMasterDemoSyn581rcuc/423:33:424
873899185,9cyclictest32171-21sh22:21:100
873899185,9cyclictest3166-21sh00:11:400
873899180,10cyclictest780-21runrttasks21:04:050
873899180,10cyclictest29439-21sh21:44:250
873899180,10cyclictest17089-21sh21:19:380
873899180,10cyclictest15846-21sh22:12:230
873899180,10cyclictest1142-21sh22:58:200
873899180,10cyclictest10655-21cron22:10:000
875299170,12cyclictest30720-21ssh23:50:313
874799176,8cyclictest755-21postgres23:55:132
874799176,8cyclictest755-21postgres23:55:132
874799171,11cyclictest16-1pr/legacy00:34:322
874799170,9cyclictest5817-21ssh22:06:342
873899174,9cyclictest780-21runrttasks19:25:580
873899174,9cyclictest24369-21sh23:29:420
873899174,9cyclictest12059-21sh23:04:440
873899170,9cyclictest8633-21sh23:20:190
873899170,9cyclictest780-21runrttasks21:12:590
873899170,9cyclictest716-21snmpd19:18:540
873899170,9cyclictest23316-21sh23:46:380
873899170,9cyclictest18019-21sh21:20:050
873899170,9cyclictest14094-21ssh22:29:590
873899170,14cyclictest12262-21sh21:52:280
873899170,13cyclictest3600-21wc23:35:240
873899170,10cyclictest780-21runrttasks20:53:400
3063099170,9tDemoTimingTask31231-21taskset20:00:015
1744099170,10tDemoTimingTask17740-21chrt20:39:555
875699164,8cyclictest16089-21latency_hist21:55:014
875699160,9cyclictest716-21snmpd19:17:554
875299164,9cyclictest716-21snmpd22:48:263
875299160,9cyclictest31962-21diskmemload22:08:213
874799164,9cyclictest716-21snmpd19:43:022
874799164,9cyclictest326-21systemd-journal00:28:282
8743991612,3cyclictest29610-21cron21:05:001
873899164,9cyclictest780-21runrttasks20:33:300
873899160,11cyclictest14815-21aten2_r5power_p22:30:130
394599160,9tDemoTimingTask3957-21chrt21:11:445
1749199160,9tDemoTimingTask10253-21sleep23:44:555
875699154,8cyclictest30083-21latency22:20:154
875699151,10cyclictest14122-21latency_hist22:30:004
875699150,9cyclictest14662-21ssh22:30:104
875699150,10cyclictest22311-21diskstats23:10:144
875299157,7cyclictest1324-21sendmail-mta19:48:593
8752991511,3cyclictest5193-21latency_hist22:25:013
875299151,10cyclictest27629-21runrttasks21:43:073
875299150,8cyclictest780-21runrttasks21:01:203
874799154,8cyclictest357-21systemd-udevd23:03:282
874799154,8cyclictest357-21systemd-udevd20:15:282
874799150,9cyclictest31528-21sh22:03:242
874799150,9cyclictest27944-21sh22:37:022
874799150,11cyclictest29428-21ssh23:31:572
874799150,11cyclictest26115-21ssh22:54:252
874399151,11cyclictest20875-21runrttasks19:35:441
874399150,9cyclictest32312-21sh00:28:261
873899154,6cyclictest23135-21aten2_r5power_p00:05:130
873899151,12cyclictest19125-21latency_hist23:45:010
873899150,13cyclictest20673-21ssh21:57:070
873899150,13cyclictest14217-21sh22:47:210
873899150,12cyclictest31897-21latency23:15:180
873899150,11cyclictest26815-21ssh23:30:210
2010639150,5EcMasterDemoSyn21888-21taskset22:34:065
1375599150,13tDemoTimingTask16426-21chrt23:25:155
875699145,7cyclictest12399-21/usr/sbin/munin22:10:194
875699143,6cyclictest25752-21grep22:00:134
875699141,9cyclictest26985-21latency_hist21:25:014
875699141,9cyclictest26219-21diskmemload00:06:214
875699141,9cyclictest22159-21runrttasks20:46:214
875699141,10cyclictest4889-21if_err_enp6s023:00:164
875699140,9cyclictest7372-21sh23:55:384
875699140,9cyclictest7372-21sh23:55:384
875699140,9cyclictest21524-21/usr/sbin/munin19:40:124
875699140,8cyclictest10832-21sh00:15:464
875699140,12cyclictest2655-21ssh22:59:254
875699140,10cyclictest9316-21ssh21:32:554
875699140,10cyclictest8639-21/usr/sbin/munin20:20:124
875699140,10cyclictest32063-21sh21:45:194
875699140,10cyclictest31065-21ssh23:50:464
875699140,10cyclictest2839-21rm21:10:584
875699140,10cyclictest27734-21sh00:25:234
875699140,10cyclictest25652-21sh21:41:444
875699140,10cyclictest25282-21wget20:55:144
875699140,10cyclictest24819-21ssh22:00:004
875699140,10cyclictest23867-21sh00:23:444
875699140,10cyclictest16309-21sh23:25:104
875299146,6cyclictest9798-21grep00:15:203
875299146,6cyclictest27509-21cut21:25:113
875299141,9cyclictest780-21runrttasks23:15:323
875299141,9cyclictest22277-21runrttasks21:58:133
875299141,9cyclictest21252-21sh00:21:513
875299141,9cyclictest12517-21unixbench-2d20:25:253
875299141,10cyclictest5806-21/usr/sbin/munin21:30:273
875299141,10cyclictest16758-21sh22:30:273
875299141,10cyclictest16-1pr/legacy20:46:203
8752991410,3cyclictest26944-21gltestperf00:25:163
875299140,10cyclictest780-21runrttasks21:11:363
875299140,10cyclictest7288-21rm23:20:063
875299140,10cyclictest7035-21sh00:14:253
875299140,10cyclictest6738-21sh23:37:333
875299140,10cyclictest4789-21chrt00:30:323
875299140,10cyclictest30665-21chrt19:55:463
875299140,10cyclictest28251-21runintdemo5min19:50:343
875299140,10cyclictest27602-21/usr/sbin/munin22:55:243
875299140,10cyclictest27194-21sh00:07:033
875299140,10cyclictest21887-21/usr/sbin/munin23:10:123
875299140,10cyclictest20613-21taskset21:20:463
875299140,10cyclictest20363-21sh23:09:183
875299140,10cyclictest19246-21ssh22:50:153
875299140,10cyclictest14038-21ssh00:00:073
875299140,10cyclictest13481-21chrt23:40:583
875299140,10cyclictest12142-21/usr/sbin/munin19:20:223
874799143,8cyclictest326-21systemd-journal20:20:282
874799143,8cyclictest19643-21grep19:35:152
874799141,9cyclictest837-21runrttasks20:03:382
874799141,9cyclictest21991-21ssh23:45:412
874799141,9cyclictest19038-21runrttasks22:14:382
874799140,9cyclictest17307-21sh23:07:082
874799140,8cyclictest31563-21sh23:51:072
874799140,8cyclictest286-21jbd2/md0-800:16:122
874799140,10cyclictest9077-21ssh22:26:262
874799140,10cyclictest8236-21rm21:32:082
874799140,10cyclictest780-21runrttasks00:37:132
874799140,10cyclictest5093-21ssh23:36:212
874799140,10cyclictest32767-21ssh21:45:262
874799140,10cyclictest32477-21sh22:40:012
874799140,10cyclictest32172-21diskmemload22:57:222
874799140,10cyclictest31885-21/usr/sbin/munin00:10:202
874799140,10cyclictest30169-21cut21:05:132
874799140,10cyclictest28759-21cat19:55:012
874799140,10cyclictest28737-21ssh21:25:212
874799140,10cyclictest28002-21sh00:07:382
874799140,10cyclictest27567-21apt-get21:00:122
874799140,10cyclictest23451-21/usr/sbin/munin20:50:162
874799140,10cyclictest22739-21ssh22:15:542
874799140,10cyclictest22213-21df_inode21:40:142
874799140,10cyclictest21677-21sh23:10:012
874799140,10cyclictest20617-21sh00:21:232
874799140,10cyclictest20267-21ssh23:26:502
874799140,10cyclictest19803-21cat21:20:252
874799140,10cyclictest18159-21switchtime19:30:222
874799140,10cyclictest14705-21/usr/sbin/munin22:30:192
874799140,10cyclictest13366-21sh21:17:002
874799140,10cyclictest12918-21ssh21:52:562
874799140,10cyclictest11160-21timerandwakeup19:15:212
874799140,10cyclictest10763-21/usr/sbin/munin23:40:132
874399146,6cyclictest27928-21grep21:25:141
874399144,8cyclictest23431-21/usr/sbin/munin23:10:241
874399143,8cyclictest4216-21swap00:30:241
874399143,8cyclictest15959-21unixbench_multi00:00:231
874399142,9cyclictest7158-21sh21:31:251
874399141,9cyclictest7331-21runrttasks21:50:091
874399141,9cyclictest4974-21runrttasks21:48:421
874399141,9cyclictest16236-21runrttasks23:25:071
874399141,9cyclictest11613-21runrttasks21:15:461
874399141,10cyclictest5477-21cpuspeed_turbos23:55:141
874399141,10cyclictest5477-21cpuspeed_turbos23:55:141
874399141,10cyclictest26463-21sh22:18:291
874399140,9cyclictest28474-21runrttasks19:52:571
874399140,11cyclictest9682-21cut22:45:131
874399140,10cyclictest9765-21apt-get19:15:091
874399140,10cyclictest9130-21chrt19:11:181
874399140,10cyclictest8406-21/usr/sbin/munin00:15:141
874399140,10cyclictest8358-21runrttasks23:38:421
874399140,10cyclictest7462-21sh23:01:291
874399140,10cyclictest716-21snmpd21:55:151
874399140,10cyclictest6570-21sh21:13:331
874399140,10cyclictest3939-21ssh22:41:371
874399140,10cyclictest31885-21/usr/sbin/munin00:10:161
874399140,10cyclictest30492-21ssh22:56:101
874399140,10cyclictest29135-21/usr/sbin/munin22:20:141
874399140,10cyclictest28939-21runrttasks22:01:341
874399140,10cyclictest28934-21ssh21:44:041
874399140,10cyclictest28923-21chrt19:55:011
874399140,10cyclictest2613-21diskstats22:05:131
874399140,10cyclictest2420-21ssh23:53:291
874399140,10cyclictest23782-21ssh22:52:461
874399140,10cyclictest23557-21if_enp6s020:50:171
874399140,10cyclictest22735-21ssh21:22:141
874399140,10cyclictest22519-21ssh23:46:031
874399140,10cyclictest20916-21fschecks_time20:45:161
874399140,10cyclictest20543-21sh23:09:261
874399140,10cyclictest19282-21ssh21:38:361
874399140,10cyclictest18547-21sh00:39:581
874399140,10cyclictest17149-21ssh22:30:451
874399140,10cyclictest14053-21sh22:11:061
874399140,10cyclictest13349-21/usr/sbin/munin20:30:121
874399140,10cyclictest12611-21sh22:28:551
873899146,7cyclictest20395-21/usr/sbin/munin19:35:210
873899146,6cyclictest22956-21grep23:10:180
873899146,6cyclictest10085-21wc00:15:240
873899145,7cyclictest27357-21cpu21:25:110
873899141,7cyclictest13312-21cat20:30:010
873899141,10cyclictest174-1kworker/0:1H+kblockd20:01:000
873899140,9cyclictest5832-21sh21:30:280
873899140,7cyclictest31357-21sh21:45:140
873899140,7cyclictest3012-21expr00:30:140
873899140,7cyclictest27910-21cat19:50:230
873899140,7cyclictest24514-21ssh22:35:150
873899140,7cyclictest21488-21awk22:15:190
873899140,12cyclictest20538-21sh22:50:290
873899140,12cyclictest13963-21latency23:05:170
873899140,10cyclictest780-21runrttasks23:50:380
873899140,10cyclictest6131-21ssh23:55:180
873899140,10cyclictest6131-21ssh23:55:180
873899140,10cyclictest31518-21sh00:27:510
873899140,10cyclictest28350-21sh22:01:090
873899140,10cyclictest22317-21latency19:40:160
873899140,10cyclictest21997-21sh00:22:230
873899140,10cyclictest19438-21wc20:40:240
873899140,10cyclictest17647-21sh00:01:340
873899140,10cyclictest14100-21sh00:36:480
2621829140,11tAtEmLog_030154-21taskset21:44:565
1000429140,0tAtEmLog_00-21swapper/523:08:205
93199131,10tDemoTimingTask8873-21taskset23:02:295
875699131,9cyclictest769-21taskset20:02:474
875699131,9cyclictest3664-21sh22:05:204
875699131,9cyclictest1836-21rm00:10:424
875699130,9cyclictest9100-21runrttasks19:10:534
875699130,9cyclictest8330-21kernelversion23:20:184
875699130,9cyclictest780-21runrttasks20:54:344
875699130,9cyclictest780-21runrttasks20:35:384
875699130,9cyclictest780-21runrttasks19:55:014
875699130,9cyclictest780-21runrttasks00:30:264
875699130,9cyclictest5955-21/usr/sbin/munin20:15:184
875699130,9cyclictest4122-21fschecks_time20:10:144
875699130,9cyclictest32697-21diskmemload22:40:104
875699130,9cyclictest31705-21runintdemo5min21:06:424
875699130,9cyclictest30887-21/usr/sbin/munin23:15:154
875699130,9cyclictest27564-21/usr/sbin/munin21:00:254
875699130,9cyclictest26585-21/usr/sbin/munin19:50:134
875699130,9cyclictest2367-21proc_pri20:05:204
875699130,9cyclictest2367-21proc_pri20:05:204
875699130,9cyclictest19973-21sh22:15:064
875699130,9cyclictest19936-21ssh22:50:194
875699130,9cyclictest19661-21/usr/sbin/munin23:45:144
875699130,9cyclictest18735-21runrttasks19:33:354
875699130,9cyclictest18179-21ssh21:20:114
875699130,9cyclictest1722-21ssh23:35:064
875699130,9cyclictest14113-21/usr/sbin/munin00:00:194
875699130,9cyclictest13438-21aten2_r5power_p20:30:124
875699130,9cyclictest12950-21/usr/sbin/munin23:05:194
875699130,9cyclictest12740-21sh23:40:264
875699130,9cyclictest12620-21ssh21:35:034
875699130,9cyclictest12142-21/usr/sbin/munin19:20:204
875699130,9cyclictest11002-21/usr/sbin/munin20:25:204
875699130,9cyclictest10826-21awk22:45:194
875699130,9cyclictest10173-21grep21:15:164
875699130,10cyclictest26448-21ssh22:35:584
875699130,10cyclictest18818-21cat20:40:174
875699130,10cyclictest16704-21ssh00:38:404
875299135,7cyclictest24446-21sed20:50:253
875299132,8cyclictest19780-21kworker/u24:1+flush-9:020:56:523
875299131,10cyclictest16-1pr/legacy20:15:553
875299131,10cyclictest16-1pr/legacy20:10:513
875299130,9cyclictest9546-21latency_hist19:15:003
875299130,9cyclictest810-21taskset20:03:173
875299130,9cyclictest5507-21sh22:25:033
875299130,9cyclictest4425-21df23:00:133
875299130,9cyclictest366-21ssh22:40:133
875299130,9cyclictest29915-21/usr/sbin/munin21:05:193
875299130,9cyclictest26311-21ssh23:30:173
875299130,9cyclictest22578-21ntp_kernel_pll_19:40:193
875299130,9cyclictest21961-21unixbench_multi22:15:253
875299130,9cyclictest20618-21chrt19:35:253
875299130,9cyclictest19454-21sh23:45:023
875299130,9cyclictest16794-21/usr/sbin/munin19:30:243
875299130,9cyclictest16470-21ssh23:25:153
875299130,9cyclictest10252-21fschecks_time19:15:123
875299130,10cyclictest9628-21head20:20:183
875299130,10cyclictest9576-21rm21:50:353
875299130,10cyclictest9144-21/usr/sbin/munin21:15:183
875299130,10cyclictest5336-21ssh23:55:133
875299130,10cyclictest5336-21ssh23:55:133
875299130,10cyclictest336-21sh21:45:273
875299130,10cyclictest28271-21sh22:01:063
875299130,10cyclictest26614-21sh22:36:043
875299130,10cyclictest1819-21grep20:05:153
875299130,10cyclictest1819-21grep20:05:143
875299130,10cyclictest15401-21missed_timers19:25:193
875299130,10cyclictest13712-21sh21:35:193
875299130,10cyclictest13416-21aten2_r5power_p20:30:123
875299130,10cyclictest12137-21rm00:35:243
875299130,10cyclictest11507-21df22:10:113
874799134,7cyclictest31315-21sh23:15:152
874799130,9cyclictest9446-21sh22:45:072
874799130,9cyclictest780-21runrttasks20:25:082
874799130,9cyclictest4912-21/usr/sbin/munin20:10:232
874799130,9cyclictest28944-21ssh22:20:022
874799130,9cyclictest28939-21/usr/sbin/munin19:55:172
874799130,9cyclictest26353-21latency_hist19:50:002
874799130,9cyclictest25193-21/usr/sbin/munin20:55:202
874799130,9cyclictest17591-21ssh00:01:312
874799130,9cyclictest14826-21timerwakeupswit20:30:232
874799130,9cyclictest14440-21chrt19:25:102
874799130,9cyclictest12742-21ssh21:35:082
874799130,9cyclictest1252-21/usr/sbin/munin20:05:122
874799130,9cyclictest1252-21/usr/sbin/munin20:05:112
874799130,9cyclictest12142-21/usr/sbin/munin19:20:152
874799130,10cyclictest960-21basename21:10:172
874799130,10cyclictest780-21runrttasks19:12:302
874799130,10cyclictest7259-21chrt23:20:052
874799130,10cyclictest18357-21expr20:40:132
874799130,10cyclictest16377-21which20:35:162
874799130,10cyclictest16200-21rm21:55:052
874399138,3cyclictest6240-21cpuspeed_turbos20:15:111
874399133,8cyclictest16956-21/usr/sbin/munin19:30:121
874399131,9cyclictest27065-21sh00:06:571
874399131,7cyclictest1775650latency_hist20:40:011
874399130,9cyclictest8875-21latency_hist19:10:001
874399130,9cyclictest731-21sshd19:21:571
874399130,9cyclictest5655-21latency_hist20:15:011
874399130,9cyclictest31780-21sh23:15:181
874399130,9cyclictest31304-21runrttasks20:00:071
874399130,9cyclictest28351-21sh23:31:101
874399130,9cyclictest23737-21/usr/sbin/munin22:35:231
874399130,9cyclictest21642-21tr19:40:121
874399130,9cyclictest18078-21/usr/sbin/munin20:40:201
874399130,9cyclictest17218-21ssh00:20:061
874399130,9cyclictest16187-21runrttasks19:26:011
874399130,9cyclictest1287-21grep20:05:121
874399130,9cyclictest1287-21grep20:05:121
874399130,9cyclictest11002-21/usr/sbin/munin20:25:161
874399130,9cyclictest10763-21/usr/sbin/munin23:40:161
874399130,10cyclictest8381-21ls23:20:181
874399130,10cyclictest716-21snmpd21:05:261
874399130,10cyclictest26416-21mailstats20:55:221
873899135,6cyclictest755-21postgres21:06:070
873899131,9cyclictest12932-21aten2_r5power_c21:35:140
873899130,9cyclictest8693-21latency_hist19:10:000
873899130,9cyclictest780-21runrttasks20:46:000
873899130,9cyclictest780-21runrttasks19:14:210
873899130,9cyclictest3589-21runrttasks20:10:020
873899130,9cyclictest26864-21runrttasks20:55:390
873899130,7cyclictest32656-21ssh22:40:090
873899130,7cyclictest174-1kworker/0:1H+kblockd20:05:140
873899130,7cyclictest174-1kworker/0:1H+kblockd20:05:130
873899130,11cyclictest16059-21/usr/sbin/munin20:35:140
873899130,10cyclictest8893-21tr20:20:140
873899130,10cyclictest30113-21sendmail_mailqu19:55:200
873899130,10cyclictest174-1kworker/0:1H+kblockd20:15:250
873899130,10cyclictest174-1kworker/0:1H+kblockd19:48:020
873899130,10cyclictest16792-21runrttasks19:30:100
873899130,10cyclictest13088-21cat19:20:200
633699130,11tDemoTimingTask8531-21chrt19:08:035
2431099130,7tDemoTimingTask24338-21taskset22:53:095
2217799131,10tDemoTimingTask22280-21taskset20:47:215
971639120,0EcMasterDemoSyn0-21swapper/519:15:055
875699120,9cyclictest23931-21/usr/sbin/munin19:45:134
875699120,9cyclictest19674-21cut19:35:154
875699120,9cyclictest14711-21cpuspeed_turbos19:25:144
875299120,9cyclictest8827-21sed19:09:593
875299120,9cyclictest18133-21cut20:40:123
875299120,9cyclictest15961-21cpuspeed_turbos20:35:143
874799120,9cyclictest21523-21open_inodes20:45:192
874399120,9cyclictest9147-21fschecks_time20:20:161
712299120,10tDemoTimingTask13822-21chrt22:10:565
3018939120,0EcMasterDemoSyn0-21swapper/500:09:125
2807929120,10tAtEmLog_01537-21chrt23:16:135
2621999120,10tDemoTimingTask603-21taskset21:45:385
2560539120,10EcMasterDemoSyn25890-21chrt19:48:535
1744099120,10tDemoTimingTask19749-21chrt20:40:385
1463229120,2tAtEmLog_016204-21chrt19:26:135
1196239120,0EcMasterDemoSyn0-21swapper/521:52:175
799339110,0EcMasterDemoSyn0-21swapper/521:32:005
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional