You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-07-20 - 05:38
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.

Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Characteristics of the 376 highest latencies:
System rack5slot1.osadl.org (updated Mon Jul 20, 2026 00:44:05)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
1128439910,0EcMasterDemoSyn1129429tAtEmLog_023:15:275
970439820,0EcMasterDemoSyn971329tAtEmLog_023:50:565
808139820,0EcMasterDemoSyn809129tAtEmLog_021:03:355
3172839820,0EcMasterDemoSyn3173829tAtEmLog_000:21:225
1966339820,0EcMasterDemoSyn1967329tAtEmLog_022:45:015
1966339820,0EcMasterDemoSyn1967329tAtEmLog_022:45:005
1618239820,0EcMasterDemoSyn1619229tAtEmLog_020:12:525
1043639820,0EcMasterDemoSyn1044629tAtEmLog_021:08:395
201439810,0EcMasterDemoSyn202429tAtEmLog_019:42:265
2830739580,0EcMasterDemoSyn2831729tAtEmLog_020:43:175
3098339260,1EcMasterDemoSyn30989-21ps20:43:171
290582190,0sleep50-21swapper/522:13:535
1812199180,9cyclictest780-21runrttasks23:26:410
1812199180,15cyclictest8874-21sh22:02:170
1812199180,14cyclictest30037-21sh21:38:270
1776899180,8tDemoTimingTask23883-21chrt21:16:405
828639170,1EcMasterDemoSyn8293-21grep00:26:260
599999170,10tDemoTimingTask11974-21chrt23:34:555
470099170,10tDemoTimingTask10396-21chrt00:10:015
438399170,7tDemoTimingTask6670-21chrt19:51:555
438399170,7tDemoTimingTask4439-21chrt19:47:545
1813799171,12cyclictest16-1pr/legacy22:39:544
1813799170,9cyclictest14767-21ssh22:24:004
18135991713,3cyclictest12438-21head22:40:173
18135991713,3cyclictest12438-21head22:40:173
1813099171,7cyclictest1429050cat20:10:002
1812199175,9cyclictest17596-21sh21:13:370
1812199173,10cyclictest8839-21sh22:38:410
1812199170,9cyclictest2891-21sh21:23:200
1812199170,9cyclictest23292-21sh00:16:430
1812199170,9cyclictest14604-21sh22:41:230
1812199170,9cyclictest14604-21sh22:41:230
1812199170,15cyclictest174-1kworker/0:1H+kblockd23:34:090
1812199170,14cyclictest29679-21sh22:31:500
1812199170,14cyclictest16575-21sh00:13:160
99229160,7tAtEmLog_03314-21chrt20:53:125
469929160,9tAtEmLog_0869-21sleep00:09:555
1813799160,9cyclictest22979-21munin-run23:05:014
18135991612,3cyclictest29497-21aten2_r5power_e21:20:213
1813599161,10cyclictest1058950latency_hist21:10:003
1813599160,9cyclictest5831-21taskset20:59:473
1813599160,7cyclictest19023-21ssh23:56:133
1813099163,9cyclictest10810-21sed21:10:012
18130991612,3cyclictest12733-21runintdemo5min21:28:562
1812699160,9cyclictest22500-21ssh22:45:381
1812199165,8cyclictest21927-21sh23:58:200
1812199160,8cyclictest12576-21sh22:22:260
1812199160,6cyclictest16505-21ssh21:49:030
1812199160,13cyclictest19809-21sh23:39:080
1776899160,7tDemoTimingTask18141-21taskset21:13:585
2329599150,9tDemoTimingTask23458-21taskset20:29:565
1869829150,13tAtEmLog_021044-21taskset23:57:415
1813799157,6cyclictest11298-21cut21:10:134
1813799155,8cyclictest24029-21/usr/sbin/munin00:35:194
1813799153,8cyclictest19962-21latency_hist22:45:004
1813799153,8cyclictest19962-21latency_hist22:45:004
1813799150,9cyclictest31670-21ssh21:20:464
18135991511,3cyclictest31039-21idleruntime-cro00:40:003
18135991511,3cyclictest1-21systemd22:00:193
1813599151,11cyclictest23967-21ssh22:29:093
1813599151,11cyclictest16-1pr/legacy22:19:373
1813599151,10cyclictest4397-21runrttasks23:11:523
1813599150,11cyclictest16-1pr/legacy23:35:423
1813099154,8cyclictest11287-21cut21:10:132
1813099154,6cyclictest9554-21grep21:45:122
1813099153,9cyclictest6994-21latency_hist19:54:592
1813099153,9cyclictest23222-21load22:10:152
18130991512,2cyclictest3012-21needreboot00:05:242
18130991511,3cyclictest32389-21cut22:15:192
1813099151,11cyclictest16-1pr/legacy23:20:292
1813099151,10cyclictest10812-21ssh22:03:392
1812699154,8cyclictest18641-21cstates23:20:141
1812699151,10cyclictest20437-21latency_hist19:15:001
1812699150,9cyclictest8644-21ssh00:26:391
1812699150,11cyclictest26433-21/usr/sbin/munin20:35:201
1812699150,11cyclictest20390-21ssh00:33:461
1812699150,10cyclictest22694-21chrt19:18:451
1812199156,7cyclictest7376-21grep23:50:120
1812199156,7cyclictest6920-21ssh00:07:440
1812199156,7cyclictest17819-21ssh00:31:550
1812199152,9cyclictest780-21runrttasks23:16:570
1812199150,9cyclictest30579-21timerwakeupswit20:40:220
1812199150,13cyclictest3876-21ssh00:24:380
1812199150,11cyclictest24249-21sh21:16:560
670939140,5EcMasterDemoSyn13664-21taskset22:23:135
3200199140,8tDemoTimingTask32005-21taskset19:37:235
2484199141,11tDemoTimingTask406-21chrt22:34:085
2018229140,4tAtEmLog_020443-21turbostat19:15:015
1813799146,6cyclictest648-21dbus-daemon20:45:004
1813799142,8cyclictest21064-21switchtime00:15:244
1813799142,8cyclictest11263-21uptime20:00:244
1813799141,9cyclictest727-21/usr/sbin/munin23:10:144
1813799141,9cyclictest27364-21ssh21:19:064
1813799141,9cyclictest25564-21runrttasks21:53:544
1813799141,9cyclictest21571-21/usr/sbin/munin23:40:204
1813799140,9cyclictest7200-21ssh22:19:584
1813799140,11cyclictest227-1md0_raid119:35:234
1813799140,10cyclictest731-21sshd20:20:294
1813799140,10cyclictest4219-21sh21:41:414
1813799140,10cyclictest30372-21sh22:14:484
1813799140,10cyclictest15330-21sh23:18:194
1813799140,10cyclictest13353-21timerandwakeup20:05:294
1813599146,6cyclictest15621-21grep00:30:263
1813599141,9cyclictest716-21snmpd23:09:023
1813599141,9cyclictest4931-21ntp_kernel_pll_23:30:193
1813599141,9cyclictest4913-21/usr/sbin/munin00:25:133
1813599141,9cyclictest25944-21ssh21:35:323
1813599141,11cyclictest16-1pr/legacy20:28:043
1813599141,10cyclictest933-21runrttasks20:47:503
1813599141,10cyclictest933-21runrttasks20:47:503
1813599141,10cyclictest16-1pr/legacy22:14:333
1813599141,10cyclictest16-1pr/legacy22:09:293
1813599141,10cyclictest16-1pr/legacy20:43:163
1813599141,10cyclictest16-1pr/legacy19:22:083
1813599141,10cyclictest16-1pr/legacy00:16:163
1813599141,10cyclictest14116-21runrttasks23:54:063
1813599140,9cyclictest18300-21head20:15:253
1813599140,8cyclictest3123-21postgres20:50:373
1813599140,8cyclictest10590-21diskmemload22:39:463
1813599140,11cyclictest14396-21wget20:10:133
1813599140,10cyclictest9402-21sh22:56:373
1813599140,10cyclictest780-21runrttasks22:30:293
1813599140,10cyclictest780-21runrttasks20:37:543
1813599140,10cyclictest5836-21/usr/sbin/munin21:25:213
1813599140,10cyclictest349-21/usr/sbin/munin21:40:243
1813599140,10cyclictest30471-21ssh00:02:593
1813599140,10cyclictest30185-21/usr/sbin/munin19:35:143
1813599140,10cyclictest27725-21/usr/sbin/munin21:55:223
1813599140,10cyclictest27019-21sh22:48:523
1813599140,10cyclictest21642-21python321:15:223
1813599140,10cyclictest21608-21ssh23:21:243
1813599140,10cyclictest16006-21sh21:48:413
1813599140,10cyclictest15757-21irqstats21:30:193
1813099143,8cyclictest14404-21aten2_r5power_p20:10:132
1813099141,9cyclictest30933-21sh22:32:452
1813099141,9cyclictest23197-21sh21:16:112
1813099141,9cyclictest20784-21sh21:50:312
1813099141,9cyclictest19802-21sh21:32:332
1813099141,9cyclictest13065-21sh23:53:212
1813099141,10cyclictest9043-21runrttasks19:57:102
1813099141,10cyclictest498-21sh23:28:092
1813099141,10cyclictest28603-21ssh22:50:002
1813099141,10cyclictest27297-21sh00:37:182
1813099140,11cyclictest6566-21ssh22:55:162
1813099140,11cyclictest14145-21rm22:41:042
1813099140,11cyclictest14145-21rm22:41:042
1813099140,10cyclictest780-21runrttasks19:39:352
1813099140,10cyclictest780-21runrttasks19:10:102
1813099140,10cyclictest5647-21sed00:25:142
1813099140,10cyclictest4853-21ssh21:24:412
1813099140,10cyclictest3566-21ssh22:53:492
1813099140,10cyclictest32242-21ssh21:57:162
1813099140,10cyclictest32113-21sh23:09:582
1813099140,10cyclictest31620-21grep20:45:112
1813099140,10cyclictest31620-21grep20:45:112
1813099140,10cyclictest26827-21threads19:25:232
1813099140,10cyclictest24282-40mandb00:00:022
1813099140,10cyclictest23850-21sh21:35:122
1813099140,10cyclictest23809-21wget20:30:122
1813099140,10cyclictest22389-21needreboot20:25:182
1813099140,10cyclictest21808-21runrttasks23:58:142
1813099140,10cyclictest20293-21rm22:26:322
1813099140,10cyclictest19351-21sh23:38:482
1813099140,10cyclictest18949-21chrt00:32:452
1813099140,10cyclictest14599-21/usr/sbin/munin23:00:162
1813099140,10cyclictest12649-21sh23:16:232
1813099140,10cyclictest10739-21sh22:21:072
1812699147,5cyclictest7789-21grep21:00:281
1812699142,9cyclictest326-21systemd-journal20:14:261
1812699142,9cyclictest32132-21ssh23:27:341
1812699141,9cyclictest731-21sshd20:45:291
1812699141,9cyclictest731-21sshd20:45:291
1812699141,9cyclictest24355-21apache200:00:001
1812699141,9cyclictest18633-21sh21:31:441
1812699141,10cyclictest18473-21diskmemload23:01:481
1812699140,12cyclictest17067-21sh22:06:431
1812699140,12cyclictest12950-21ssh23:35:141
1812699140,11cyclictest28937-21ssh23:07:401
1812699140,10cyclictest9296-21/usr/sbin/munin23:15:141
1812699140,10cyclictest9123-21ssh22:02:281
1812699140,10cyclictest8725-21cut22:20:171
1812699140,10cyclictest780-21runrttasks19:40:491
1812699140,10cyclictest756-21postgres20:58:371
1812699140,10cyclictest716-21snmpd00:10:321
1812699140,10cyclictest5410-21ssh22:36:141
1812699140,10cyclictest522-21ssh23:45:491
1812699140,10cyclictest349-21/usr/sbin/munin21:40:161
1812699140,10cyclictest32051-21ssh00:04:071
1812699140,10cyclictest31037-21ssh21:56:241
1812699140,10cyclictest30885-21ssh22:32:431
1812699140,10cyclictest30176-21chrt19:35:051
1812699140,10cyclictest25493-21ssh22:11:211
1812699140,10cyclictest25000-21sh00:35:411
1812699140,10cyclictest23930-21ssh21:16:421
1812699140,10cyclictest23834-21sh21:52:411
1812699140,10cyclictest23569-21ssh21:35:001
1812699140,10cyclictest23137-21sh00:16:371
1812699140,10cyclictest20730-21sshd20:20:301
1812699140,10cyclictest2024-21awk23:10:251
1812699140,10cyclictest1456-21ssh22:15:531
1812699140,10cyclictest14216-21runrttasks23:54:101
1812699140,10cyclictest14045-21ssh21:47:171
1812699140,10cyclictest1210-21runrttasks21:22:081
1812699140,10cyclictest11864-21ssh22:58:281
1812199145,7cyclictest19154-21ssh21:32:060
1812199143,8cyclictest1112-21missed_timers19:40:190
1812199142,8cyclictest780-21runrttasks19:36:260
1812199141,9cyclictest28369-21runrttasks20:38:320
1812199141,9cyclictest26936-21sh23:06:140
1812199141,9cyclictest26599-21processes19:25:200
1812199141,7cyclictest27150-21latency_hist21:55:000
1812199141,7cyclictest174-1kworker/0:1H+kblockd20:20:240
1812199141,10cyclictest14017-21runrttasks20:09:550
1812199141,10cyclictest10705-21open_files20:00:170
1812199140,7cyclictest764-21ssh22:15:260
1812199140,7cyclictest641-21tr21:40:120
1812199140,7cyclictest14234-21sed22:05:190
1812199140,12cyclictest24966-21basename00:00:140
1812199140,12cyclictest22505-21grep22:10:120
1812199140,11cyclictest16705-21rm23:00:320
1812199140,10cyclictest780-21runrttasks22:59:350
1812199140,10cyclictest780-21runrttasks20:15:340
1812199140,10cyclictest6588-21taskset23:13:280
1812199140,10cyclictest6101-21latency_hist21:00:010
1812199140,10cyclictest4727-21cat19:50:000
1812199140,10cyclictest420-21ssh22:51:380
1812199140,10cyclictest326-21systemd-journal19:24:010
1812199140,10cyclictest32135-21idleruntime20:45:140
1812199140,10cyclictest32135-21idleruntime20:45:140
1812199140,10cyclictest30464-21sh23:45:110
1812199140,10cyclictest27615-21sh21:55:070
1812199140,10cyclictest25414-21ssh23:41:440
1812199140,10cyclictest23878-21sh00:35:180
1812199140,10cyclictest23386-21chrt20:28:570
1812199140,10cyclictest22534-21rm22:45:390
1812199140,10cyclictest21174-21ssh23:21:050
1812199140,10cyclictest19553-21uname19:10:190
1812199140,10cyclictest16706-21ssh22:25:080
1812199140,10cyclictest15573-21/usr/sbin/munin20:10:210
1812199140,10cyclictest11106-21sh21:27:460
1812199140,10cyclictest10422-21runrttasks21:08:360
1272439141,2EcMasterDemoSyn14294-21turbostat21:30:015
1813799139,3cyclictest3981-21cpuspeed_turbos23:30:134
1813799137,6cyclictest18117-21cyclictest00:10:274
1813799131,9cyclictest28457-21/usr/sbin/munin00:20:164
1813799131,9cyclictest24878-21sh00:00:104
1813799131,9cyclictest16-1pr/legacy22:50:034
1813799131,8cyclictest30252-21diskmemload23:45:014
1813799130,9cyclictest9210-21/usr/sbin/munin21:05:174
1813799130,9cyclictest7657-21grep23:50:144
1813799130,9cyclictest716-21snmpd20:53:454
1813799130,9cyclictest716-21snmpd20:45:364
1813799130,9cyclictest716-21snmpd20:45:354
1813799130,9cyclictest6958-21diskmemload22:00:544
1813799130,9cyclictest6516-21cstates21:00:164
1813799130,9cyclictest5805-21/usr/sbin/munin22:55:214
1813799130,9cyclictest5680-21sh21:25:044
1813799130,9cyclictest4734-21ssh00:25:024
1813799130,9cyclictest3603-21/usr/sbin/munin19:45:174
1813799130,9cyclictest32557-21/usr/sbin/munin19:40:244
1813799130,9cyclictest30289-21rm23:26:134
1813799130,9cyclictest27829-21/usr/sbin/munin19:30:264
1813799130,9cyclictest27725-21/usr/sbin/munin21:55:194
1813799130,9cyclictest26493-21aten2_r5power_e20:35:134
1813799130,9cyclictest25967-21ssh23:05:314
1813799130,9cyclictest25493-21sh22:30:014
1813799130,9cyclictest23862-21/usr/sbin/munin21:35:254
1813799130,9cyclictest23245-21cpu19:20:144
1813799130,9cyclictest20726-21runrttasks19:15:004
1813799130,9cyclictest20279-21/usr/sbin/munin22:45:154
1813799130,9cyclictest18672-21runrttasks20:19:064
1813799130,9cyclictest16646-21rm22:25:054
1813799130,9cyclictest16310-21diskstats23:55:134
1813799130,9cyclictest14844-21/usr/sbin/munin21:30:164
1813799130,9cyclictest14760-21sh22:05:224
1813799130,9cyclictest13744-21/usr/sbin/munin00:30:134
1813799130,9cyclictest12649-21/usr/sbin/munin23:35:134
1813799130,10cyclictest5678-21ssh00:06:514
1813799130,10cyclictest25709-21cpuspeed_turbos19:25:144
1813799130,10cyclictest21963-21cut20:25:144
1813799130,10cyclictest18094-21ssh23:20:054
1813799130,10cyclictest12621-21sh21:46:164
1813599135,7cyclictest29286-21/usr/sbin/munin00:20:163
1813599131,9cyclictest7687-21sh22:20:053
1813599131,9cyclictest6698-21runrttasks19:52:183
1813599131,9cyclictest21313-21diskmemload23:40:003
1813599131,9cyclictest17992-21diskmemload23:01:273
1813599131,9cyclictest10602-21diskmemload00:10:103
1813599130,9cyclictest9630-21/usr/sbin/munin20:00:143
1813599130,9cyclictest9207-21ssh23:15:073
1813599130,9cyclictest3774-21mailstats19:45:183
1813599130,9cyclictest30422-21runrttasks22:50:183
1813599130,9cyclictest27173-21/usr/sbin/munin23:25:223
1813599130,9cyclictest25469-21/usr/sbin/munin19:25:123
1813599130,9cyclictest18387-21/usr/sbin/munin19:10:123
1813599130,9cyclictest18342-21latency_hist19:10:013
1813599130,9cyclictest14501-21sh21:11:263
1813599130,7cyclictest21100-21diskstats19:15:153
1813599130,10cyclictest780-21runrttasks21:50:093
1813599130,10cyclictest3620-21cat00:05:313
1813599130,10cyclictest30634-21grep23:45:133
1813599130,10cyclictest28865-21netstat19:30:203
1813599130,10cyclictest24981-21cut20:30:203
1813599130,10cyclictest20774-21taskset20:21:063
1813599130,10cyclictest14105-21cut20:09:593
1813099131,10cyclictest16-1pr/legacy20:02:422
1813099130,9cyclictest8234-21latency_hist21:05:002
1813099130,9cyclictest780-21runrttasks23:40:072
1813099130,9cyclictest4267-21ssh23:30:152
1813099130,9cyclictest4241-21runrttasks19:45:532
1813099130,9cyclictest3806-21/usr/sbin/munin20:55:142
1813099130,9cyclictest349-21/usr/sbin/munin21:40:122
1813099130,9cyclictest32501-21ssh23:10:012
1813099130,9cyclictest30289-21sh23:45:032
1813099130,9cyclictest28298-21ssh00:20:042
1813099130,9cyclictest26502-21aten2_r5power_p20:35:132
1813099130,9cyclictest20739-21/usr/sbin/munin19:15:162
1813099130,9cyclictest19979-21fschecks_count00:15:152
1813099130,9cyclictest19070-21/usr/sbin/munin20:20:242
1813099130,9cyclictest17373-21idleruntime20:15:152
1813099130,9cyclictest14376-21sed22:05:192
1813099130,9cyclictest10416-21sh00:10:022
1813099130,7cyclictest29859-21irqstats20:40:162
1813099130,10cyclictest808-21hddtemp_smartct19:40:172
1813099130,10cyclictest29499-21chrt19:30:362
1813099130,10cyclictest2895-21cat20:50:242
1813099130,10cyclictest25117-21runrttasks19:24:282
1813099130,10cyclictest2278-21ssh22:35:092
1812699137,6cyclictest18117-21cyclictest19:30:371
1812699130,9cyclictest9630-21/usr/sbin/munin20:00:191
1812699130,9cyclictest9019-21rm00:09:141
1812699130,9cyclictest8534-21/usr/sbin/munin21:05:131
1812699130,9cyclictest780-21runrttasks20:54:251
1812699130,9cyclictest780-21runrttasks20:07:301
1812699130,9cyclictest7257-21/usr/sbin/munin19:55:231
1812699130,9cyclictest716-21snmpd23:30:021
1812699130,9cyclictest5836-21/usr/sbin/munin21:25:171
1812699130,9cyclictest4892-21chrt19:50:021
1812699130,9cyclictest4322-21runrttasks19:46:581
1812699130,9cyclictest28939-21rm22:50:011
1812699130,9cyclictest27115-21users19:25:251
1812699130,9cyclictest24721-21missed_timers20:30:191
1812699130,9cyclictest21412-21taskset20:25:031
1812699130,9cyclictest21323-21diskmemload23:40:011
1812699130,9cyclictest16778-21/usr/sbin/munin22:25:161
1812699130,9cyclictest16685-21/usr/sbin/munin20:15:181
1812699130,9cyclictest13307-21sh22:40:281
1812699130,9cyclictest13307-21sh22:40:281
1812699130,9cyclictest11033-21ssh21:10:071
1812699130,8cyclictest24216-21chrt19:20:211
1812699130,10cyclictest30482-21ssh00:20:281
1812199131,7cyclictest2032-21gltestperf20:50:150
1812199130,9cyclictest7257-21munin-node19:55:140
1812199130,9cyclictest5256-21df_inode19:50:140
1812199130,7cyclictest7532-21cat21:00:270
1812199130,7cyclictest174-1kworker/0:1H+kblockd20:31:220
1812199130,10cyclictest28029-21cpuspeed19:30:150
1812199130,10cyclictest21992-21smart_sda19:15:220
1619229130,3tAtEmLog_018446-21chrt20:16:425
1578829130,2tAtEmLog_018887-21chrt22:25:315
1545399130,11tDemoTimingTask17776-21chrt19:06:475
764639120,10EcMasterDemoSyn13442-21chrt21:46:525
2902799120,10tDemoTimingTask630-21chrt22:51:475
1813799120,9cyclictest7343-21aten2_r5power_p19:55:154
1813799120,9cyclictest4899-21runrttasks19:50:094
1813799120,9cyclictest3797-21runrttasks20:55:054
1813799120,9cyclictest25540-21runrttasks20:31:514
1813799120,9cyclictest19155-21kernelversion19:10:174
1813799120,9cyclictest14765-21fschecks_count20:10:154
1813599120,9cyclictest7113-21sed21:00:213
1813599120,9cyclictest32553-21runrttasks19:40:103
1813599120,8cyclictest7843-21grep19:55:183
1812199120,7cyclictest18075-21latency_hist19:10:010
1190539120,1EcMasterDemoSyn651irq_work/522:04:265
569839110,0EcMasterDemoSyn0-21swapper/520:58:295
568939110,0EcMasterDemoSyn0-21swapper/522:55:085
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional