You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-05-07 - 02:47
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.

Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Characteristics of the 376 highest latencies:
System rack5slot1.osadl.org (updated Thu May 07, 2026 00:44:05)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
94942860,0sleep30-21swapper/300:10:133
2499739850,0EcMasterDemoSyn2500829tAtEmLog_021:20:185
2756039830,0EcMasterDemoSyn2757029tAtEmLog_020:49:525
209639830,0EcMasterDemoSyn210629tAtEmLog_022:36:235
2000939830,0EcMasterDemoSyn2001929tAtEmLog_023:22:015
587139820,0EcMasterDemoSyn588129tAtEmLog_023:32:085
3248039820,0EcMasterDemoSyn3249029tAtEmLog_000:22:525
2914939820,0EcMasterDemoSyn2916129tAtEmLog_023:27:055
2415039820,0EcMasterDemoSyn2416029tAtEmLog_019:33:485
2339839820,0EcMasterDemoSyn2340829tAtEmLog_000:17:485
1497239820,0EcMasterDemoSyn1498229tAtEmLog_023:37:145
1598939800,0EcMasterDemoSyn1599929tAtEmLog_021:50:435
635329200,0tAtEmLog_00-21swapper/523:01:435
1247799191,13cyclictest16-1pr/legacy20:44:463
2757199180,13tDemoTimingTask28205-21taskset20:50:015
1928199180,10tDemoTimingTask23088-21chrt00:00:005
12477991810,6cyclictest10227-21cut21:30:123
1247499185,9cyclictest13144-21sh23:18:320
1247499185,9cyclictest13144-21sh23:18:310
1247499181,8cyclictest30731-21latency23:10:150
12474991810,6cyclictest13601-21grep23:00:240
1247499180,14cyclictest27139-21sh00:20:120
1247499180,14cyclictest24461-21sh22:13:310
1247499180,10cyclictest27620-21sh21:57:170
1247499180,10cyclictest24666-21sh22:30:500
1247499180,10cyclictest10661-21sh23:52:450
635499170,10tDemoTimingTask6453-21chrt22:56:425
1700799170,15tDemoTimingTask19225-21chrt19:21:455
1247799171,12cyclictest16-1pr/legacy19:28:433
1247799170,4cyclictest20081-21ssh21:35:203
1247499174,6cyclictest29497-21cat21:40:230
1247499170,9cyclictest5052-21latency_hist21:10:000
1247499170,9cyclictest21771-21sh00:16:400
1247499170,9cyclictest17230-21sh21:51:340
1247499170,9cyclictest16447-21sh22:09:280
1247499170,9cyclictest16112-21sh00:14:010
1247499170,14cyclictest3866-21sh00:06:430
1247499170,14cyclictest316-21sh23:29:380
1247499170,14cyclictest15587-21sh22:25:490
1247499170,13cyclictest16515-21sh23:55:330
1247499170,12cyclictest6904-21sh23:32:520
707799160,9tDemoTimingTask12853-21taskset22:25:015
3125299160,9tDemoTimingTask31256-21chrt19:49:025
1569539160,14EcMasterDemoSyn17863-21taskset20:27:095
1247699169,6cyclictest30100-21tr23:10:112
1247499160,9cyclictest780-21runrttasks19:48:370
1247499160,5cyclictest780-21runrttasks22:50:240
1247499160,13cyclictest26347-21sh23:43:510
1247899154,6cyclictest553-21fschecks_time00:05:134
1247899153,9cyclictest716-21snmpd23:14:554
1247899151,11cyclictest16-1pr/legacy22:16:044
1247899151,11cyclictest16-1pr/legacy00:38:044
1247799153,8cyclictest14005-21swap19:10:223
1247799150,9cyclictest23371-21ssh23:41:453
1247699154,8cyclictest18283-21cpuspeed00:15:132
1247699151,10cyclictest9114-21runrttasks22:22:362
1247699150,9cyclictest30027-21ssh00:21:072
1247699150,9cyclictest14081-21cat19:10:222
1247699150,8cyclictest27699-21sh00:02:002
1247699150,8cyclictest19187-21sh23:21:272
1247599151,10cyclictest8857-21ssh22:58:251
1247599150,9cyclictest31156-21ssh23:10:171
1247599150,9cyclictest20039-21sh23:22:021
1247599150,8cyclictest21054-21sh00:16:101
1247599150,10cyclictest30457-21ssh23:27:591
1247499156,7cyclictest14294-21sh23:36:440
1247499151,9cyclictest15433-21runrttasks22:44:220
1247499151,12cyclictest20487-21latency_hist20:35:000
1247499151,11cyclictest1324-21sendmail-mta19:51:060
1247499150,9cyclictest8062-21sh21:29:220
1247499150,9cyclictest8062-21sh21:29:210
1247499150,9cyclictest780-21runrttasks21:04:530
1247499150,12cyclictest780-21runrttasks20:28:000
1247499150,12cyclictest27039-21apt-config22:15:000
2888639140,8EcMasterDemoSyn26653-21sleep19:44:555
2084029140,12tAtEmLog_021374-21taskset22:11:235
1700799140,12tDemoTimingTask17027-21chrt19:18:385
1247899146,5cyclictest60-21ksoftirqd/420:10:124
1247899143,8cyclictest28460-21cut21:40:144
1247899143,8cyclictest10686-21netstat21:30:174
1247899141,9cyclictest24585-21/usr/sbin/munin19:35:204
1247899141,9cyclictest24472-21diskmemload21:55:214
1247899141,9cyclictest20855-21sh23:58:364
1247899141,9cyclictest19120-21taskset00:33:244
1247899141,9cyclictest16607-21diskmemload00:14:224
1247899141,11cyclictest16-1pr/legacy22:21:094
1247899140,10cyclictest9145-21chrt23:15:454
1247899140,10cyclictest9145-21chrt23:15:444
1247899140,10cyclictest7269-21sed20:05:184
1247899140,10cyclictest6433-21sh22:03:484
1247899140,10cyclictest5337-21timerandwakeup20:00:234
1247899140,10cyclictest29816-21taskset22:34:264
1247899140,10cyclictest28744-21ssh22:51:004
1247899140,10cyclictest18266-21ssh23:20:484
1247899140,10cyclictest18076-21sh21:52:114
1247899140,10cyclictest17949-21chrt20:28:204
1247899140,10cyclictest15452-21ssh22:08:474
1247799146,6cyclictest14041-21cut21:50:143
1247799145,7cyclictest3182-21tune2fs22:55:153
1247799144,8cyclictest17509-21/usr/sbin/munin19:20:123
1247799143,8cyclictest728-21lldpd23:06:393
1247799143,8cyclictest24718-21needreboot00:00:193
1247799143,8cyclictest15858-21tr21:15:203
1247799141,9cyclictest9122-21sh21:11:353
1247799141,9cyclictest30869-21sh23:28:153
1247799141,9cyclictest29307-21runrttasks19:45:083
1247799141,9cyclictest10236-21ssh23:35:023
1247799141,10cyclictest5369-21/usr/sbin/munin22:20:183
1247799141,10cyclictest24051-21sed21:55:183
1247799140,12cyclictest19990-21sh22:28:533
1247799140,10cyclictest8700-21rm20:09:593
1247799140,10cyclictest780-21runrttasks00:20:053
1247799140,10cyclictest7798-21ssh21:46:203
1247799140,10cyclictest7482-21sh23:33:173
1247799140,10cyclictest7465-21sh21:28:563
1247799140,10cyclictest7465-21sh21:28:553
1247799140,10cyclictest7375-21sh22:04:283
1247799140,10cyclictest6546-21ssh22:39:313
1247799140,10cyclictest6290-21irqstats23:50:183
1247799140,10cyclictest4918-21sed20:00:163
1247799140,10cyclictest3966-21/usr/sbin/munin00:25:203
1247799140,10cyclictest3659-21ssh23:13:263
1247799140,10cyclictest3321-21taskset19:56:143
1247799140,10cyclictest32322-21ssh00:05:023
1247799140,10cyclictest31734-21ssh22:17:043
1247799140,10cyclictest30114-21taskset20:53:433
1247799140,10cyclictest29732-21sh22:51:403
1247799140,10cyclictest29305-21ssh21:40:213
1247799140,10cyclictest28898-21ssh22:33:473
1247799140,10cyclictest28201-21rm00:38:263
1247799140,10cyclictest21456-21hddtemp_smartct20:35:163
1247799140,10cyclictest18034-21ssh00:15:103
1247799140,10cyclictest16737-21ssh22:45:053
1247799140,10cyclictest15665-21fschecks_time19:15:133
1247799140,10cyclictest15639-21sh23:20:053
1247799140,10cyclictest14767-21ssh22:43:533
1247799140,10cyclictest14388-21/usr/sbin/munin23:55:253
1247799140,10cyclictest11655-21ssh23:00:113
1247799140,10cyclictest10402-21sed22:05:243
1247799140,10cyclictest10382-21ssh23:16:383
1247799140,10cyclictest10382-21ssh23:16:383
1247699146,6cyclictest716-21snmpd23:42:542
1247699143,8cyclictest23412-21smartctl00:35:202
1247699142,9cyclictest720-21ntpd23:35:182
1247699141,9cyclictest24874-21/usr/sbin/munin23:25:182
1247699141,9cyclictest19232-21sh22:45:412
1247699141,9cyclictest18069-21sh21:34:582
1247699141,9cyclictest1604-21/usr/sbin/munin19:55:192
1247699141,9cyclictest13719-21runrttasks20:20:042
1247699140,12cyclictest16330-21/usr/sbin/munin23:55:252
1247699140,10cyclictest9879-21ssh21:47:472
1247699140,10cyclictest7811-21ssh00:26:452
1247699140,10cyclictest780-21runrttasks23:15:542
1247699140,10cyclictest780-21runrttasks23:15:532
1247699140,10cyclictest780-21runrttasks20:15:132
1247699140,10cyclictest780-21runrttasks00:33:142
1247699140,10cyclictest6769-21sh22:39:392
1247699140,10cyclictest5325-21chrt23:50:072
1247699140,10cyclictest3485-21ssh22:55:172
1247699140,10cyclictest3477-21ssh23:30:272
1247699140,10cyclictest32700-21ntp_kernel_err19:50:152
1247699140,10cyclictest32016-21sh22:00:102
1247699140,10cyclictest31265-21ssh22:52:442
1247699140,10cyclictest28570-21df20:50:142
1247699140,10cyclictest27387-21/usr/sbin/munin22:15:252
1247699140,10cyclictest26920-21ssh21:21:112
1247699140,10cyclictest25834-21ssh21:56:012
1247699140,10cyclictest23208-21runrttasks20:40:062
1247699140,10cyclictest2229-21ssh21:43:492
1247699140,10cyclictest20949-21ssh22:11:042
1247699140,10cyclictest20577-21sh21:35:252
1247699140,10cyclictest20507-21rm22:29:152
1247699140,10cyclictest18881-21ssh23:04:062
1247699140,10cyclictest18188-21sh21:16:332
1247699140,10cyclictest16329-21sh21:50:572
1247699140,10cyclictest15199-21ssh22:08:362
1247699140,10cyclictest14144-21sh00:12:382
1247699140,10cyclictest14031-21latency_hist21:15:002
1247699140,10cyclictest1301-21ssh00:05:162
1247599143,6cyclictest27683-21cat19:40:161
1247599141,9cyclictest6935-21/usr/sbin/munin23:15:131
1247599141,9cyclictest6935-21/usr/sbin/munin23:15:121
1247599141,9cyclictest6101-21sh00:08:161
1247599141,9cyclictest3869-21sh21:44:571
1247599141,9cyclictest31661-21ssh23:46:041
1247599141,9cyclictest30007-21runrttasks20:52:141
1247599141,9cyclictest2829-21chrt21:25:401
1247599141,9cyclictest2829-21chrt21:25:401
1247599141,10cyclictest14901-21grep20:20:191
1247599141,10cyclictest10544-21ssh00:10:201
1247599140,9cyclictest8710-21ssh23:34:091
1247599140,9cyclictest780-21runrttasks20:16:321
1247599140,9cyclictest731-21sshd19:30:291
1247599140,9cyclictest11724-21/usr/sbin/munin23:35:191
1247599140,9cyclictest1156350cp21:30:261
1247599140,9cyclictest10219-21ssh00:28:261
1247599140,10cyclictest8826-21ssh21:47:031
1247599140,10cyclictest780-21runrttasks21:36:211
1247599140,10cyclictest780-21runrttasks00:30:251
1247599140,10cyclictest7646-21ssh22:40:041
1247599140,10cyclictest5413-21/usr/sbin/munin23:50:211
1247599140,10cyclictest481-21/usr/sbin/munin21:00:141
1247599140,10cyclictest4092-21wget22:20:091
1247599140,10cyclictest32013-21df19:50:101
1247599140,10cyclictest29544-21sh22:15:341
1247599140,10cyclictest29279-21ssh00:20:351
1247599140,10cyclictest27901-21diskmemload22:50:241
1247599140,10cyclictest27048-21ssh23:08:271
1247599140,10cyclictest23040-21ssh23:41:321
1247599140,10cyclictest22263-21cat20:35:241
1247599140,10cyclictest15839-21rm21:50:381
1247599140,10cyclictest14388-21/usr/sbin/munin23:55:131
1247599140,10cyclictest13091-21/usr/sbin/munin22:25:151
1247599140,10cyclictest11662-21/usr/sbin/munin23:00:141
1247499147,6cyclictest12968-21grep20:15:250
1247499146,7cyclictest174-1kworker/0:1H+kblockd19:35:190
1247499146,6cyclictest4540-21grep22:20:120
1247499146,6cyclictest23872-21/usr/sbin/munin19:30:240
1247499146,6cyclictest23680-21ssh00:35:220
1247499141,9cyclictest4329-21df20:00:120
1247499141,7cyclictest8407-21cat22:05:010
1247499141,10cyclictest16165-21ntp_offset19:15:180
1247499141,10cyclictest13914-21find19:10:180
1247499140,9cyclictest4602-21sh22:55:270
1247499140,9cyclictest16878-21sh22:45:110
1247499140,7cyclictest776-21sh22:35:260
1247499140,7cyclictest28795-21apt-get23:45:110
1247499140,7cyclictest21343-21cut23:05:160
1247499140,12cyclictest14177-21ntpq00:30:180
1247499140,11cyclictest22861-21sh21:19:460
1247499140,10cyclictest780-21runrttasks21:11:360
1247499140,10cyclictest5462-21sh00:25:210
1247499140,10cyclictest28578-21grep19:40:240
1247499140,10cyclictest26448-21rm00:01:060
1247499140,10cyclictest26209-21rm21:39:160
1247499140,10cyclictest20185-21df_inode19:25:150
1247499140,10cyclictest18578-21sh23:21:010
1247499140,10cyclictest10979-21diskmemload21:30:180
991599130,11tDemoTimingTask12235-21chrt19:08:135
43999131,10tDemoTimingTask2392-21taskset21:03:095
3022729130,2tAtEmLog_032246-21chrt20:55:445
2959699130,11tDemoTimingTask323502sleep522:53:325
2536899131,10tDemoTimingTask28850-21chrt22:33:455
2500829134,0tAtEmLog_00-21swapper/521:25:115
2500829134,0tAtEmLog_00-21swapper/521:25:105
2283199130,8tDemoTimingTask22853-21taskset20:39:465
1247899139,3cyclictest3352-21fschecks_time21:05:154
1247899139,3cyclictest13945-21cpuspeed_turbos20:20:124
1247899135,7cyclictest12472-21cyclictest19:27:544
1247899132,8cyclictest17644-21smartctl22:45:164
1247899131,9cyclictest25668-21runrttasks00:00:334
1247899131,8cyclictest8871-21missed_timers22:40:164
1247899131,8cyclictest18760-21/usr/sbin/munin21:35:114
1247899130,9cyclictest780-21runrttasks19:40:224
1247899130,9cyclictest5915-21ssh23:50:164
1247899130,9cyclictest463-21runintdemo5min21:00:034
1247899130,9cyclictest4586-21sh21:45:114
1247899130,9cyclictest32643-21grep19:50:154
1247899130,9cyclictest31245-21hddtemp_smartct20:55:154
1247899130,9cyclictest31154-21/usr/sbin/munin22:35:194
1247899130,9cyclictest31046-21taskset19:46:304
1247899130,9cyclictest30180-21chrt20:54:374
1247899130,9cyclictest28788-21/usr/sbin/munin23:45:154
1247899130,9cyclictest25565-21/usr/sbin/munin20:45:164
1247899130,9cyclictest25158-21expr23:25:144
1247899130,9cyclictest23988-21awk21:20:134
1247899130,9cyclictest23943-21taskset19:31:104
1247899130,9cyclictest22250-21sh23:05:214
1247899130,9cyclictest21295-21fschecks_time20:35:154
1247899130,9cyclictest19673-21/usr/sbin/munin00:15:234
1247899130,9cyclictest19306-21sh23:40:024
1247899130,9cyclictest1913-21entropy23:30:154
1247899130,9cyclictest18433-21/usr/sbin/munin20:30:144
1247899130,9cyclictest15095-21/usr/sbin/munin19:15:134
1247899130,9cyclictest14829-21ssh21:15:134
1247899130,9cyclictest13781-21/usr/sbin/munin19:10:174
1247899130,9cyclictest13523-21grep22:25:134
1247899130,9cyclictest12393-21runrttasks23:35:254
1247899130,8cyclictest780-21runrttasks20:40:224
1247899130,6cyclictest17176-21apt-get22:10:024
1247899130,12cyclictest339-21ssh21:25:084
1247899130,12cyclictest339-21ssh21:25:074
1247899130,10cyclictest5765-21cut21:10:124
1247899130,10cyclictest5047-21rm22:55:454
1247899130,10cyclictest4532-21fschecks_time00:25:144
1247899130,10cyclictest27394-21tr00:20:124
1247899130,10cyclictest2200-21tail19:55:144
1247899130,10cyclictest18041-21tune2fs19:20:144
1247899130,10cyclictest11586-21ssh23:00:084
1247799130,9cyclictest8985-21/usr/sbin/munin20:10:123
1247799130,9cyclictest780-21runrttasks21:00:013
1247799130,9cyclictest30863-21cpuspeed_turbos20:55:123
1247799130,9cyclictest3058-21sort21:05:133
1247799130,9cyclictest29274-21fschecks_count23:45:143
1247799130,9cyclictest27367-21cut19:40:133
1247799130,9cyclictest26031-21fschecks_time20:45:143
1247799130,9cyclictest24574-21runrttasks19:35:003
1247799130,9cyclictest23697-21sh21:20:083
1247799130,9cyclictest22233-21/usr/sbin/munin19:30:193
1247799130,9cyclictest18008-21/usr/sbin/munin22:10:123
1247799130,9cyclictest17774-21taskset20:25:553
1247799130,9cyclictest14188-21tune2fs20:20:133
1247799130,9cyclictest13116-21runrttasks20:16:513
1247799130,9cyclictest12920-21ssh00:30:093
1247799130,9cyclictest12572-21latency_hist19:10:013
1247799130,10cyclictest780-21runrttasks20:30:223
1247699132,8cyclictest17471-21/usr/sbin/munin19:20:152
1247699132,8cyclictest17189-21proc_pri20:25:192
1247699132,6cyclictest30373-21ntp_offset19:45:182
1247699131,9cyclictest6321-21taskset20:05:012
1247699131,9cyclictest400-21ssh21:25:102
1247699131,9cyclictest400-21ssh21:25:102
1247699131,9cyclictest31160-21sh23:45:422
1247699131,9cyclictest21090-21cpuspeed_turbos23:05:132
1247699130,9cyclictest9457-21fschecks_time20:10:152
1247699130,9cyclictest780-21runrttasks21:05:582
1247699130,9cyclictest780-21runrttasks20:30:052
1247699130,9cyclictest30581-21aten2_r5power_c20:55:112
1247699130,9cyclictest26959-21/usr/sbin/munin19:40:172
1247699130,9cyclictest25561-21runrttasks20:45:072
1247699130,9cyclictest24585-21/usr/sbin/munin19:35:162
1247699130,9cyclictest22434-21cpuspeed19:30:142
1247699130,9cyclictest20787-21/usr/sbin/munin20:35:192
1247699130,9cyclictest1706-21/usr/sbin/munin21:00:212
1247699130,9cyclictest15095-21/usr/sbin/munin19:15:122
1247699130,10cyclictest8333-21fschecks_time22:40:132
1247699130,10cyclictest22101-21sh22:30:092
1247699130,10cyclictest20701-21/usr/sbin/munin19:25:172
1247599139,3cyclictest19865-21unixbench_multi22:10:231
1247599131,9cyclictest31363-21cpuspeed22:35:111
1247599131,9cyclictest17862-21runrttasks20:27:071
1247599130,9cyclictest8808-21cmp20:10:001
1247599130,9cyclictest780-21runrttasks20:06:131
1247599130,9cyclictest5201-21ssh21:10:001
1247599130,9cyclictest3383-21runrttasks19:57:051
1247599130,9cyclictest32296-21taskset20:56:211
1247599130,9cyclictest32072-21/usr/sbin/munin22:00:191
1247599130,9cyclictest29310-21/usr/sbin/munin19:45:241
1247599130,9cyclictest25566-21needreboot19:35:171
1247599130,9cyclictest25565-21/usr/sbin/munin20:45:121
1247599130,9cyclictest24557-21chrt00:35:521
1247599130,9cyclictest23428-21diskmemload00:00:071
1247599130,9cyclictest23212-21/usr/sbin/munin20:40:151
1247599130,9cyclictest21932-21ssh22:30:021
1247599130,9cyclictest20102-21cpuspeed_turbos19:25:131
1247599130,9cyclictest17710-21cpuspeed_turbos19:20:121
1247599130,9cyclictest16835-21taskset19:16:341
1247599130,10cyclictest9207-21fschecks_time22:05:131
1247599130,10cyclictest5826-21runrttasks20:02:591
1247599130,10cyclictest3715-21wc21:05:171
1247599130,10cyclictest23865-21ssh21:55:161
1247599130,10cyclictest23748-21ssh21:20:091
1247599130,10cyclictest19098-21smartctl20:30:141
1247599130,10cyclictest17018-21/usr/sbin/munin22:45:121
1247599130,10cyclictest16869-21sh21:15:371
1247499139,3cyclictest6340-21unixbench_singl21:45:240
1247499131,9cyclictest7864-21sed20:05:250
1247499130,9cyclictest780-21runrttasks20:46:110
1247499130,9cyclictest31507-21missed_timers20:55:170
1247499130,7cyclictest24089-21/usr/sbin/munin20:40:170
1247499130,7cyclictest174-1kworker/0:1H+kblockd20:36:140
1247499130,7cyclictest174-1kworker/0:1H+kblockd20:21:310
1247499130,7cyclictest174-1kworker/0:1H+kblockd19:21:260
1247499130,10cyclictest28575-21sh20:50:130
1247499130,10cyclictest25316-21runintdemo5min21:20:210
707799123,7tDemoTimingTask11975-21chrt22:24:375
520599120,10tDemoTimingTask13342-21taskset00:12:025
3125299120,10tDemoTimingTask912-21taskset19:50:325
3031139120,0EcMasterDemoSyn0-21swapper/522:16:055
2853599121,9tDemoTimingTask3339-21taskset00:06:205
1332799120,10tDemoTimingTask15390-21taskset20:20:315
1247899120,8cyclictest11755-21fschecks_count20:15:154
1247799124,6cyclictest31771-21aten2_r5power_v19:50:093
1247699124,6cyclictest5174-21mailstats20:00:182
1247599124,6cyclictest13954-21which19:10:191
1247599120,8cyclictest12624-21latency_hist19:10:001
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional