You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-01-04 - 10:53
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.

Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Characteristics of the 376 highest latencies:
System rack5slot1.osadl.org (updated Sun Jan 04, 2026 00:44:07)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
22000391130,1EcMasterDemoSyn22007-21runintdemo5min23:50:370
2646391040,0EcMasterDemoSyn2655-21runintdemo5min21:54:000
3005921030,0sleep10-21swapper/122:44:101
199492940,0sleep50-21swapper/523:14:205
2200039910,0EcMasterDemoSyn2201029tAtEmLog_023:50:375
1138639900,0EcMasterDemoSyn1139629tAtEmLog_019:47:135
1006139900,0EcMasterDemoSyn1007129tAtEmLog_020:53:085
1006139900,0EcMasterDemoSyn1007129tAtEmLog_020:53:085
3108839830,0EcMasterDemoSyn3109829tAtEmLog_023:55:425
903039820,0EcMasterDemoSyn904029tAtEmLog_019:42:095
394039820,0EcMasterDemoSyn395029tAtEmLog_019:32:005
3054539820,0EcMasterDemoSyn3055629tAtEmLog_023:20:125
261339820,0EcMasterDemoSyn262329tAtEmLog_020:37:565
1239839820,0EcMasterDemoSyn1241029tAtEmLog_022:34:335
2088439810,0EcMasterDemoSyn2089429tAtEmLog_000:26:075
2083839810,0EcMasterDemoSyn2084829tAtEmLog_020:07:305
1741239810,0EcMasterDemoSyn1742229tAtEmLog_023:30:205
324172680,1sleep50-21swapper/522:10:015
3030239680,0EcMasterDemoSyn0-21swapper/120:27:471
46052330,0sleep20-21swapper/223:23:372
24863992315,6cyclictest15606-21munin-run23:29:593
27482200,1sleep20-21swapper/221:36:042
2486099206,10cyclictest10882-21sh22:50:400
2426899190,8tDemoTimingTask27003-21chrt21:15:035
2486099184,10cyclictest831-21runrttasks20:38:200
2486099181,8cyclictest14-21ksoftirqd/021:42:070
24860991815,2cyclictest28800-21aten2_r5power_c23:55:130
2486099181,12cyclictest16-1pr/legacy19:42:080
2486099181,12cyclictest14-21ksoftirqd/000:19:340
2486099180,9cyclictest6305-21sh23:24:490
2486099180,9cyclictest26383-21sh00:11:140
2486099177,2cyclictest171rcu_preempt23:32:360
2486099174,9cyclictest17701-21sh21:26:550
2486099173,11cyclictest14-21ksoftirqd/021:20:200
2486099171,12cyclictest14-21ksoftirqd/022:45:390
2486099171,12cyclictest14-21ksoftirqd/000:04:350
2486099170,9cyclictest21408-21sh22:21:000
2486099170,9cyclictest14-21ksoftirqd/022:07:320
2486099170,9cyclictest14-21ksoftirqd/000:28:470
2486099170,8cyclictest14-21ksoftirqd/000:30:490
2486099170,14cyclictest11097-21sh00:39:380
2486099170,13cyclictest32516-21ssh22:10:050
1705699170,10tDemoTimingTask17075-21taskset22:19:215
1683829170,7tAtEmLog_017031-21chrt22:54:585
1480999170,9tDemoTimingTask12614-21sleep21:04:555
1480999170,7tDemoTimingTask17059-21chrt21:07:135
1200799170,9tDemoTimingTask13549-21taskset22:00:005
382099160,9tDemoTimingTask10132-21taskset23:44:565
3031229160,9tAtEmLog_030804-21taskset20:30:015
2486499169,5cyclictest19665-21sed20:05:174
2486499161,11cyclictest16-1pr/legacy00:15:574
2486399160,10cyclictest23262-21basename22:05:143
2486299169,6cyclictest25340-21grep20:15:242
2486299165,8cyclictest9349-21ls00:20:142
2486299164,9cyclictest327-21systemd-journal21:09:072
2486299164,8cyclictest7026-21mailstats20:45:202
2486299164,8cyclictest7026-21mailstats20:45:202
2486199168,6cyclictest18316-21grep00:25:131
2486199164,8cyclictest28210-21sensors_temp23:00:211
24861991612,3cyclictest28166-21turbostat.cron23:54:591
2486099164,7cyclictest14-21ksoftirqd/000:05:380
2486099163,10cyclictest12467-21sh23:10:100
2486099162,6cyclictest14-21ksoftirqd/022:58:500
2486099161,11cyclictest14-21ksoftirqd/023:38:460
2486099160,8cyclictest14-21ksoftirqd/023:42:390
2486099160,8cyclictest14-21ksoftirqd/023:17:320
2486099160,7cyclictest16636-21cat20:00:000
2486099160,7cyclictest14-21ksoftirqd/021:19:440
2486099160,12cyclictest14-21ksoftirqd/023:28:430
2486099160,12cyclictest14-21ksoftirqd/022:35:010
2426899160,7tDemoTimingTask24780-21chrt21:13:455
1375799160,9tDemoTimingTask14150-21chrt19:55:005
2486499154,8cyclictest32413-21grep20:30:244
2486499153,8cyclictest27414-21fschecks_time00:30:164
2486399157,6cyclictest29067-21tail20:25:143
2486399153,8cyclictest2544-21fschecks_count19:30:143
2486399152,9cyclictest771-21sshd19:17:243
2486399152,9cyclictest16893-21ssh21:26:243
2486399152,10cyclictest5401-21cut22:30:193
2486399152,10cyclictest30874-21sh22:26:143
2486399151,10cyclictest8420-21runrttasks21:56:343
2486399150,9cyclictest27303-21mailstats20:20:203
2486399150,9cyclictest17592-21sh23:12:393
2486399150,11cyclictest831-21runrttasks23:59:253
2486399150,11cyclictest1506-21chrt19:26:043
2486399150,10cyclictest7233-21sh21:21:093
2486299153,9cyclictest18428-21tune2fs21:10:162
2486299152,9cyclictest12091-21sh22:51:322
24862991511,3cyclictest4750-21sendmail00:00:002
2486299150,9cyclictest28836-21sh22:07:592
2486299150,9cyclictest11908-21latency_hist19:50:002
2486299150,6cyclictest22920-21cut21:30:132
2486199152,9cyclictest731-21gdbus21:30:211
24861991511,3cyclictest13795-21cpuspeed_turbos21:25:141
2486199151,10cyclictest744-21snmpd00:39:281
2486199150,11cyclictest6559-21sh21:20:441
2486199150,11cyclictest15744-21grep00:05:201
2486199150,11cyclictest14992-21sh22:53:341
2486199150,10cyclictest17405-21runrttasks23:48:431
2486099156,7cyclictest24720-21users22:40:260
2486099156,7cyclictest11962-21grep23:45:200
2486099153,8cyclictest831-21runrttasks21:04:310
24860991512,2cyclictest9593-21/usr/sbin/munin19:45:160
2486099151,11cyclictest14-21ksoftirqd/023:03:470
2486099151,10cyclictest5970-21sh23:05:520
2486099151,10cyclictest18431-21sh22:02:090
2486099150,9cyclictest11203-21sh21:58:300
2452829150,6tAtEmLog_024568-21taskset19:06:505
2486499147,5cyclictest11172-21sed20:55:154
2486499144,7cyclictest24268-21smartctl22:40:254
2486499142,8cyclictest7025-21sh23:25:064
2486499142,8cyclictest32396-21cpuspeed19:25:134
2486499141,9cyclictest20126-21ssh23:14:284
2486499140,12cyclictest17654-21/usr/sbin/munin22:55:144
2486499140,10cyclictest8688-21sh23:07:444
2486499140,10cyclictest7267-21ssh21:39:064
2486499140,10cyclictest6996-21rm22:30:474
2486499140,10cyclictest32202-21ssh23:02:534
2486499140,10cyclictest31661-21chrt22:09:544
2486499140,10cyclictest31595-21ssh22:45:004
2486499140,10cyclictest30868-21tr23:20:144
2486499140,10cyclictest30761-21rm21:51:014
2486499140,10cyclictest29872-21rm00:13:444
2486499140,10cyclictest27829-21basename22:25:144
2486499140,10cyclictest26114-21sh21:31:174
2486499140,10cyclictest22531-21ssh22:21:464
2486499140,10cyclictest12945-21sh22:16:304
2486499140,10cyclictest10012-21ssh00:02:194
2486399146,7cyclictest807-21postgres20:47:123
2486399146,7cyclictest807-21postgres20:47:123
2486399143,8cyclictest19081-21seq00:07:253
2486399141,9cyclictest32523-21aten2_r5power_c00:15:123
2486399141,9cyclictest31641-21sh22:45:023
2486399141,9cyclictest2336-21sh23:21:593
2486399141,9cyclictest22902-21ssh00:27:333
2486399141,9cyclictest15509-21cpuspeed_turbos21:05:123
2486399141,10cyclictest8205-21diskmemload23:07:233
2486399140,9cyclictest29945-21ssh23:01:183
2486399140,9cyclictest19770-21sh22:55:323
2486399140,9cyclictest19123-21awk21:10:193
2486399140,9cyclictest14516-21ssh22:17:353
2486399140,9cyclictest14292-21/usr/sbin/munin19:55:153
2486399140,12cyclictest19413-21ssh22:20:163
2486399140,11cyclictest11100-21ssh00:39:393
2486399140,10cyclictest9710-21ssh00:02:063
2486399140,10cyclictest9263-21ntpq20:50:213
2486399140,10cyclictest9263-21ntpq20:50:213
2486399140,10cyclictest9090-21/usr/sbin/munin00:20:263
2486399140,10cyclictest6446-21runrttasks19:38:333
2486399140,10cyclictest4011-21sh21:36:563
2486399140,10cyclictest31942-21processes20:30:193
2486399140,10cyclictest3144-21rm22:11:053
2486399140,10cyclictest31263-21ssh21:51:223
2486399140,10cyclictest30014-21ssh00:13:513
2486399140,10cyclictest2928-21ssh21:19:353
2486399140,10cyclictest28499-21ssh22:43:043
2486399140,10cyclictest27304-21sh21:32:063
2486399140,10cyclictest26667-21unixbench-2d19:10:253
2486399140,10cyclictest26258-21ssh23:17:233
2486399140,10cyclictest22815-21ssh23:51:123
2486399140,10cyclictest21720-21ssh22:04:233
2486399140,10cyclictest18620-21ssh23:49:353
2486399140,10cyclictest18373-21sh23:30:343
2486399140,10cyclictest17091-21grep20:00:143
2486399140,10cyclictest13484-21ssh22:35:053
2486399140,10cyclictest13468-21ssh22:52:293
2486399140,10cyclictest11943-21/usr/sbin/munin19:50:123
2486399140,10cyclictest11644-21ls19:50:003
2486299146,6cyclictest327-21systemd-journal00:16:242
2486299143,8cyclictest327-21systemd-journal19:24:072
2486299142,9cyclictest23844-21ssh22:58:242
2486299142,9cyclictest14032-21fschecks_count21:25:152
2486299141,9cyclictest15687-21timerandwakeup22:00:252
2486299141,9cyclictest10315-21sh23:26:142
2486299141,10cyclictest32610-21sh21:52:182
2486299140,10cyclictest9356-21ssh21:22:362
2486299140,10cyclictest9341-21ssh22:15:072
2486299140,10cyclictest831-21runrttasks19:26:012
2486299140,10cyclictest7547-21sh00:00:342
2486299140,10cyclictest6777-21ssh23:06:242
2486299140,10cyclictest6338-21/usr/sbin/munin21:55:212
2486299140,10cyclictest5373-21ssh22:48:132
2486299140,10cyclictest4253-21rm22:30:022
2486299140,10cyclictest3264-21/usr/sbin/munin00:35:242
2486299140,10cyclictest32528-21sh22:10:062
2486299140,10cyclictest31803-21needreboot20:30:172
2486299140,10cyclictest28663-21sed00:30:272
2486299140,10cyclictest27977-21tr23:00:202
2486299140,10cyclictest27412-21sh00:11:582
2486299140,10cyclictest26360-21cat23:35:182
2486299140,10cyclictest2625-21fschecks_time19:30:152
2486299140,10cyclictest26163-21sh22:41:262
2486299140,10cyclictest23976-21rm23:34:342
2486299140,10cyclictest22495-21ssh22:21:452
2486299140,10cyclictest22273-21ssh00:27:052
2486299140,10cyclictest21421-21sh21:46:092
2486299140,10cyclictest21287-21ssh23:15:032
2486299140,10cyclictest16457-21ssh23:48:022
2486299140,10cyclictest14738-21runrttasks21:02:362
2486299140,10cyclictest1342-21runrttasks20:35:202
2486199147,7cyclictest24858-21cyclictest23:13:071
2486199143,8cyclictest744-21snmpd20:36:241
2486199143,8cyclictest6442-21uptime22:30:261
2486199142,9cyclictest24206-21tune2fs20:15:141
2486199141,9cyclictest7173-21ssh23:25:111
2486199141,9cyclictest32314-21timerwakeupswit23:20:251
2486199141,9cyclictest10569-21aten2_r5power_c20:55:121
2486199141,11cyclictest21112-21ssh21:11:171
2486199141,10cyclictest325-21gltestperf19:25:151
24861991410,3cyclictest29492-21gltestperf23:55:161
2486199140,8cyclictest6176-21smartctl21:55:211
2486199140,10cyclictest831-21runrttasks22:15:291
2486199140,10cyclictest831-21runrttasks00:14:391
2486199140,10cyclictest7460-21ssh21:39:131
2486199140,10cyclictest6755-21missed_timers20:45:181
2486199140,10cyclictest6755-21missed_timers20:45:181
2486199140,10cyclictest6375-21ssh22:48:551
2486199140,10cyclictest5227-21sh00:00:041
2486199140,10cyclictest5138-21timerwakeupswit23:05:241
2486199140,10cyclictest4617-21sh23:41:021
2486199140,10cyclictest4513-21/usr/sbin/munin19:35:241
2486199140,10cyclictest31199-21ssh21:51:191
2486199140,10cyclictest30798-21ssh22:26:101
2486199140,10cyclictest29425-21sh23:37:021
2486199140,10cyclictest28403-21missed_timers19:15:191
2486199140,10cyclictest28198-21ssh22:07:341
2486199140,10cyclictest27851-21missed_timers00:30:191
2486199140,10cyclictest2771-21ssh00:15:581
2486199140,10cyclictest27218-21/usr/sbin/munin21:15:141
2486199140,10cyclictest22906-21grep20:10:251
2486199140,10cyclictest22536-21ssh23:15:191
2486199140,10cyclictest20607-21ssh22:56:071
2486199140,10cyclictest18582-21grep21:45:151
2486199140,10cyclictest18442-21ssh22:20:051
2486199140,10cyclictest16195-21/usr/sbin/munin23:30:281
2486199140,10cyclictest14438-21sh21:42:421
2486199140,10cyclictest14015-21/usr/sbin/munin22:00:131
2486199140,10cyclictest13647-21cat22:35:131
2486199140,10cyclictest11182-21ssh00:20:321
2486099146,7cyclictest221rcuc/021:30:150
2486099145,7cyclictest6041-21grep19:35:240
2486099145,7cyclictest15295-21basename21:05:110
2486099144,5cyclictest20235-21sed21:45:260
2486099142,8cyclictest19448-21fschecks_count20:05:170
2486099141,9cyclictest7759-21runrttasks20:48:180
2486099141,9cyclictest7759-21runrttasks20:48:180
2486099141,9cyclictest30278-21runrttasks20:27:350
2486099141,7cyclictest12602-21latency_hist21:00:000
2486099141,10cyclictest32315-21apt-get21:35:160
2486099140,9cyclictest14-21ksoftirqd/019:20:240
2486099140,12cyclictest29680-21head22:25:250
2486099140,12cyclictest18328-21diskstats21:10:150
2486099140,10cyclictest9217-21ssh22:15:010
2486099140,10cyclictest8873-21hddtemp_smartct20:50:180
2486099140,10cyclictest8873-21hddtemp_smartct20:50:180
2486099140,10cyclictest4270-21sh22:30:030
2486099140,10cyclictest3846-21basename20:40:190
2486099140,10cyclictest380-21grep19:25:160
2486099140,10cyclictest26122-21cut20:20:120
2486099140,10cyclictest25468-21cstates19:10:140
2486099140,10cyclictest23511-21date20:15:000
2486099140,10cyclictest17425-21kernelversion20:00:170
2486099140,10cyclictest13672-21runrttasks19:51:240
2486099140,10cyclictest12018-21sh00:21:070
2141729140,12tAtEmLog_026040-21taskset23:17:135
2981799130,11tDemoTimingTask5339-21taskset00:35:295
2710539130,2EcMasterDemoSyn651irq_work/523:35:245
2589899130,11tDemoTimingTask30804-21chrt00:14:255
2486499139,3cyclictest17986-21aten2_r5power_e21:10:134
2486499132,8cyclictest24302-21ssh23:16:004
2486499131,9cyclictest19798-21runrttasks21:45:214
2486499131,9cyclictest16954-21runrttasks21:05:474
2486499131,9cyclictest15989-21runrttasks19:56:004
2486499130,9cyclictest9593-21/usr/sbin/munin19:45:194
2486499130,9cyclictest831-21runrttasks20:40:124
2486499130,9cyclictest831-21runrttasks20:25:044
2486499130,9cyclictest831-21runrttasks19:24:104
2486499130,9cyclictest7720-21runintdemo5min20:48:054
2486499130,9cyclictest7720-21runintdemo5min20:48:054
2486499130,9cyclictest4682-21/usr/sbin/munin21:55:124
2486499130,9cyclictest4513-21/usr/sbin/munin19:35:144
2486499130,9cyclictest4270-21aten2_r5power_v21:20:124
2486499130,9cyclictest4136-21sh22:11:484
2486499130,9cyclictest327-21systemd-journal20:00:094
2486499130,9cyclictest3120-21sh23:40:194
2486499130,9cyclictest27357-21aten2_r5power_v21:15:134
2486499130,9cyclictest26107-21/usr/sbin/munin20:20:244
2486499130,9cyclictest23722-21/usr/sbin/munin20:15:124
2486499130,9cyclictest20075-21sh21:28:324
2486499130,9cyclictest19613-21ssh23:50:054
2486499130,9cyclictest16967-21ssh23:30:164
2486499130,9cyclictest14608-21latency22:35:174
2486499130,9cyclictest14260-21diskmemload00:05:094
2486499130,9cyclictest14015-21/usr/sbin/munin22:00:214
2486499130,9cyclictest13384-21cut21:00:144
2486499130,9cyclictest11943-21/usr/sbin/munin19:50:124
2486499130,9cyclictest11333-21sh00:20:394
2486499130,9cyclictest10757-21ssh23:45:094
2486499130,11cyclictest3118-21seq00:35:064
2486499130,10cyclictest8495-21chrt22:50:084
2486499130,10cyclictest675-21ssh23:57:074
2486499130,10cyclictest25998-21irqstats23:35:154
2486499130,10cyclictest17941-21ssh00:25:104
2486499130,10cyclictest10552-21rm21:40:204
2486399131,7cyclictest24946-21cat19:10:013
2486399130,9cyclictest8851-21grep19:40:283
2486399130,9cyclictest745-21/usr/sbin/munin20:35:223
2486399130,9cyclictest31648-21runintdemo5min19:21:533
2486399130,9cyclictest26797-21/usr/sbin/munin00:30:123
2486399130,9cyclictest23722-21/usr/sbin/munin20:15:253
2486399130,9cyclictest21370-21/usr/sbin/munin20:10:153
2486399130,9cyclictest19908-21missed_timers20:05:203
2486399130,9cyclictest18299-21runrttasks21:45:073
2486399130,9cyclictest1581-21ssh23:40:033
2486399130,9cyclictest12098-21unixbench_multi20:55:243
2486399130,9cyclictest12017-21ssh21:41:033
2486399130,8cyclictest24973-21chrt23:35:043
2486299135,6cyclictest9603-21ls20:50:252
2486299135,6cyclictest9603-21ls20:50:252
2486299130,9cyclictest744-21snmpd22:25:342
2486299130,9cyclictest7246-21/usr/sbin/munin19:40:242
2486299130,9cyclictest4513-21/usr/sbin/munin19:35:192
2486299130,9cyclictest4369-21mailstats20:40:232
2486299130,9cyclictest27482-21/usr/sbin/munin19:15:132
2486299130,9cyclictest26107-21/usr/sbin/munin20:20:142
2486299130,9cyclictest21370-21/usr/sbin/munin20:10:252
2486299130,9cyclictest19581-21sh23:50:042
2486299130,9cyclictest15122-21latency19:55:172
2486299130,9cyclictest13666-21taskset19:51:222
2486299130,9cyclictest12506-21/usr/sbin/munin23:10:202
2486299130,10cyclictest9461-21ssh21:40:142
2486299130,10cyclictest831-21runrttasks23:40:072
2486299130,10cyclictest29694-21ssh21:15:472
2486299130,10cyclictest26117-21grep19:10:172
2486299130,10cyclictest20687-21runrttasks20:05:372
2486299130,10cyclictest16728-21wget20:00:122
2486299130,10cyclictest14078-21ssh00:05:022
2486299130,10cyclictest13538-21ssh22:35:082
2486199135,6cyclictest15378-21aten2_r5power_v21:05:121
2486199132,8cyclictest20446-21timerandwakeup20:05:261
2486199130,9cyclictest9887-21chrt20:50:541
2486199130,9cyclictest9887-21chrt20:50:541
2486199130,9cyclictest9647-21aten2_r5power_e19:45:141
2486199130,9cyclictest31222-21fschecks_count20:30:141
2486199130,9cyclictest29859-21/usr/sbin/munin19:20:181
2486199130,9cyclictest28102-21taskset20:24:231
2486199130,9cyclictest2589-21fschecks_count19:30:151
2486199130,9cyclictest17354-21idleruntime20:00:161
2486199130,9cyclictest14710-21taskset21:02:151
2486199130,9cyclictest11943-21/usr/sbin/munin19:50:151
2486199130,10cyclictest7538-21cpuspeed_turbos19:40:181
2486199130,10cyclictest32682-21apt-get22:10:121
2486199130,10cyclictest3140-21/usr/sbin/munin20:40:271
2486199130,10cyclictest26870-21chrt19:11:341
2486199130,10cyclictest14912-21gltestperf19:55:151
2486099131,8cyclictest25055-21cat20:15:240
2486099130,9cyclictest831-21runrttasks19:34:410
2486099130,9cyclictest31047-21cut20:30:130
2486099130,9cyclictest29014-21unixbench-2d19:15:250
1191099130,11tDemoTimingTask14822-21chrt00:23:095
500129120,9tAtEmLog_07098-21chrt20:45:215
500129120,9tAtEmLog_07098-21chrt20:45:215
3163239120,0EcMasterDemoSyn0-21swapper/519:21:525
2972739120,0EcMasterDemoSyn0-21swapper/521:33:425
2924639120,0EcMasterDemoSyn0-21swapper/519:16:475
2690199120,10tDemoTimingTask27108-21taskset19:14:095
2634199120,10tDemoTimingTask1695-21chrt22:28:295
2556439120,0EcMasterDemoSyn0-21swapper/520:17:395
2486499122,7cyclictest22624-21smartctl20:10:234
2486499120,9cyclictest8654-21fschecks_count20:50:164
2486499120,9cyclictest8654-21fschecks_count20:50:164
2486499120,9cyclictest745-21/usr/sbin/munin20:35:174
2486499120,9cyclictest7151-21cmp19:40:004
2486499120,9cyclictest29191-21runrttasks19:16:114
2486499120,9cyclictest25814-21idleruntime19:10:174
2486499120,9cyclictest2578-21tune2fs19:30:154
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional