You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-09-18 - 14:40
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.

Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Characteristics of the 376 highest latencies:
System rack5slot1.osadl.org (updated Fri Sep 18, 2026 12:44:07)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
1509339910,0EcMasterDemoSyn1510329tAtEmLog_008:12:345
88639830,0EcMasterDemoSyn89829tAtEmLog_010:54:505
669639830,0EcMasterDemoSyn670629tAtEmLog_009:03:165
92039820,0EcMasterDemoSyn93129tAtEmLog_007:42:105
845239820,0EcMasterDemoSyn846229tAtEmLog_010:04:095
58439820,0EcMasterDemoSyn59429tAtEmLog_012:26:085
316239820,0EcMasterDemoSyn317229tAtEmLog_011:50:385
2970039820,0EcMasterDemoSyn2971029tAtEmLog_012:05:515
2691439820,0EcMasterDemoSyn2692429tAtEmLog_008:37:555
1746339820,0EcMasterDemoSyn1747329tAtEmLog_008:17:395
1273339820,0EcMasterDemoSyn1274329tAtEmLog_008:07:315
3195639810,0EcMasterDemoSyn3196629tAtEmLog_009:59:045
2089339810,0EcMasterDemoSyn2090329tAtEmLog_010:29:305
2089339810,0EcMasterDemoSyn2090329tAtEmLog_010:29:305
196239810,0EcMasterDemoSyn197229tAtEmLog_008:53:095
1949939810,0EcMasterDemoSyn1950929tAtEmLog_009:33:435
1060039810,0EcMasterDemoSyn1061029tAtEmLog_009:28:375
1653539800,0EcMasterDemoSyn1654529tAtEmLog_007:06:395
1202839800,0EcMasterDemoSyn0-21swapper/410:24:264
226552240,1sleep50-21swapper/511:06:305
2127599210,16tDemoTimingTask21538-21chrt07:19:555
1585229190,0tAtEmLog_00-21swapper/509:18:285
2090329180,0tAtEmLog_00-21swapper/510:34:335
2090329180,0tAtEmLog_00-21swapper/510:34:335
16878991814,3cyclictest5938-21turbostat12:30:002
16874991810,6cyclictest12820-21grep12:15:121
16874991810,6cyclictest12820-21grep12:15:111
16869991814,3cyclictest32203-21turbostat08:50:010
1686999180,10cyclictest8439-21sh11:16:580
1686999180,10cyclictest785-21runrttasks12:30:150
1686999180,10cyclictest25432-21sh09:36:370
1686999180,10cyclictest23057-21sh12:20:220
1686999180,10cyclictest23057-21sh12:20:220
2365899170,10tDemoTimingTask23689-21chrt07:21:555
1985229170,0tAtEmLog_00-21swapper/508:27:465
1687999173,10cyclictest704-21gdbus10:05:193
1687899171,12cyclictest16-1pr/legacy10:14:162
1687499175,9cyclictest715-21snmpd09:42:241
1686999170,9cyclictest26034-21sh12:04:340
1686999170,9cyclictest16380-21sh09:31:250
1686999170,14cyclictest7663-21sh09:26:310
1686999170,14cyclictest495-21sh10:54:370
1686999170,14cyclictest4454-21ssh12:10:150
1686999170,14cyclictest2669-21sh09:42:110
1686999170,12cyclictest10698-21ssh09:46:370
1521699170,10tDemoTimingTask15235-21chrt10:44:435
1354899170,7tDemoTimingTask18473-21chrt11:22:515
311939160,0EcMasterDemoSyn0-21swapper/510:19:215
2971199160,9tDemoTimingTask3290-21chrt12:10:015
2692429160,7tAtEmLog_029273-21chrt08:42:525
2692429160,7tAtEmLog_029273-21chrt08:42:515
1688099168,6cyclictest15662-21sort12:35:144
1687999160,9cyclictest6617-21sh11:15:373
1687999160,9cyclictest25914-21runrttasks07:25:513
1687999160,9cyclictest13020-21sh11:38:243
1687899164,8cyclictest14865-21unixbench_multi09:30:242
16874991613,2cyclictest12304-21kworker/1:0+events07:42:091
1686999164,9cyclictest11147-21sh10:41:430
1686999160,9cyclictest785-21runrttasks08:30:230
1686999160,9cyclictest785-21runrttasks07:52:110
1686999160,9cyclictest22354-21runrttasks08:29:220
1686999160,8cyclictest1872-21ssh11:31:340
1686999160,7cyclictest19601-21ls10:10:120
1686999160,7cyclictest10262-21fschecks_time11:55:150
1686999160,14cyclictest26610-21sh09:19:490
1686999160,12cyclictest9157-21ssh10:59:280
1686999160,10cyclictest21149-21ssh09:52:510
1038629160,7tAtEmLog_010460-21taskset08:03:025
978229150,6tAtEmLog_015513-21chrt11:02:415
93129150,7tAtEmLog_03174-21taskset07:45:535
3221029150,6tAtEmLog_04311-21chrt11:33:235
1738329150,6tAtEmLog_022644-21taskset10:11:255
1688099157,6cyclictest3568-21grep08:55:214
1688099155,8cyclictest24320-21/usr/sbin/munin07:25:124
1688099150,8cyclictest19161-21ssh10:28:144
1688099150,8cyclictest19161-21ssh10:28:134
1687999158,6cyclictest1285-21sendmail-mta11:13:553
1687999156,2cyclictest0-21swapper/312:15:593
1687999156,2cyclictest0-21swapper/312:15:593
1687999155,7cyclictest334-21systemd-journal09:42:243
1687999154,8cyclictest25767-21fschecks_count10:50:143
1687999151,9cyclictest1446-21latency_hist07:45:003
16879991512,2cyclictest0-21swapper/308:45:013
16879991512,2cyclictest0-21swapper/308:45:013
1687999151,10cyclictest29335-21ssh12:05:343
1687999150,9cyclictest18044-21awk10:45:223
1687899152,9cyclictest9228-21diskmemload11:36:492
1687899150,11cyclictest19426-21date07:15:002
1687499158,5cyclictest31720-21sed10:35:161
1687499154,8cyclictest5998-21cat11:15:241
1687499154,6cyclictest645-21dbus-daemon12:35:001
1687499153,8cyclictest8568-21apt-get08:00:121
1687499152,10cyclictest18610-21ssh11:22:571
1687499151,10cyclictest1825-21taskset08:51:251
1686999156,7cyclictest9317-21latency_hist09:10:000
1686999156,7cyclictest9122-21basename11:55:000
1686999154,8cyclictest785-21runrttasks07:42:170
1686999153,9cyclictest754-21postgres08:10:320
1686999153,9cyclictest21073-21sed11:05:240
1686999153,10cyclictest28795-21missed_timers09:20:170
1686999151,10cyclictest785-21runrttasks10:16:310
1686999150,8cyclictest4380-21postgres08:58:320
1688099148,5cyclictest15914-21wc11:40:114
1688099148,5cyclictest11016-21wc11:55:204
1688099145,7cyclictest334-21systemd-journal10:15:034
1688099143,7cyclictest1562-21kworker/u24:0+nfsiod11:00:044
1688099142,9cyclictest30942-21sh12:06:434
1688099142,8cyclictest5161-21expr09:00:124
1688099141,10cyclictest4275-21cut09:25:114
1688099141,10cyclictest16-1pr/legacy09:43:494
1688099141,10cyclictest15726-21sh11:20:504
1688099140,9cyclictest25464-21latency11:45:174
1688099140,9cyclictest21793-21sh09:35:084
1688099140,10cyclictest9931-21sh09:46:044
1688099140,10cyclictest785-21runrttasks09:10:554
1688099140,10cyclictest4250-21fschecks_count07:50:144
1688099140,10cyclictest3169-21runrttasks07:45:484
1688099140,10cyclictest30713-21ssh10:35:004
1688099140,10cyclictest30401-21cat11:29:594
1688099140,10cyclictest26739-21runrttasks10:14:244
1688099140,10cyclictest24797-21apt-config10:50:014
1688099140,10cyclictest24771-21munin-run08:35:014
1688099140,10cyclictest20461-21/usr/sbin/munin08:25:094
1688099140,10cyclictest19048-21sh09:51:184
1688099140,10cyclictest18843-21diskstats12:00:134
1688099140,10cyclictest1358-21sh12:26:384
1688099140,10cyclictest13037-21/usr/sbin/munin09:30:174
1688099140,10cyclictest12833-21diskmemload12:33:394
1688099140,10cyclictest12481-21rm12:15:084
1688099140,10cyclictest12481-21rm12:15:074
1688099140,10cyclictest1-21systemd07:57:574
1688099140,10cyclictest11857-21ssh11:19:284
1688099140,10cyclictest11175-21sed10:05:164
1687999146,6cyclictest17693-21turbostat.cron08:20:003
1687999146,6cyclictest10113-21tune2fs11:55:143
1687999145,7cyclictest19616-21/usr/sbin/munin12:00:183
1687999145,7cyclictest18522-21ssh09:15:083
1687999142,9cyclictest11930-21netstat08:05:203
1687999142,8cyclictest7731-21unixbench_multi07:55:233
1687999141,9cyclictest9973-21timerandwakeup08:00:243
1687999141,9cyclictest4152-21sh10:38:043
1687999141,9cyclictest24744-21sh10:30:533
1687999141,9cyclictest24744-21sh10:30:533
1687999141,9cyclictest19927-21runrttasks11:42:003
1687999141,10cyclictest17897-21chrt07:10:163
1687999141,10cyclictest17472-21sh09:32:143
1687999140,9cyclictest22712-21/usr/sbin/munin08:30:113
1687999140,10cyclictest9255-21ssh12:12:583
1687999140,10cyclictest8987-21runrttasks09:07:373
1687999140,10cyclictest8643-21sh10:40:173
1687999140,10cyclictest8199-21ssh09:45:183
1687999140,10cyclictest785-21runrttasks11:26:433
1687999140,10cyclictest6369-21runrttasks12:30:073
1687999140,10cyclictest5386-21ssh10:56:423
1687999140,10cyclictest5284-21ssh11:34:083
1687999140,10cyclictest4822-21/usr/sbin/munin09:00:233
1687999140,10cyclictest32501-21/usr/sbin/munin08:50:193
1687999140,10cyclictest3217-21chrt07:46:273
1687999140,10cyclictest3096-21gltestperf08:55:163
1687999140,10cyclictest30662-21chrt07:36:273
1687999140,10cyclictest30648-21perl08:45:153
1687999140,10cyclictest29738-21sh09:20:283
1687999140,10cyclictest28573-21sh09:56:383
1687999140,10cyclictest28078-21ssh10:15:083
1687999140,10cyclictest26615-21wget07:30:113
1687999140,10cyclictest26088-21cat11:45:233
1687999140,10cyclictest25520-21ssh12:22:043
1687999140,10cyclictest25520-21ssh12:22:043
1687999140,10cyclictest21712-21rm09:35:043
1687999140,10cyclictest20358-21/usr/sbin/munin08:25:103
1687999140,10cyclictest19489-21taskset07:15:013
1687999140,10cyclictest19263-21/usr/sbin/munin11:05:243
1687999140,10cyclictest18731-21ssh09:51:043
1687999140,10cyclictest18171-21ssh12:36:093
1687999140,10cyclictest15469-21sh10:25:313
1687999140,10cyclictest15469-21sh10:25:303
1687999140,10cyclictest14655-21ssh11:20:203
1687999140,10cyclictest13472-21cpuspeed_turbos08:10:123
1687999140,10cyclictest1342-21sh10:00:073
1687999140,10cyclictest12735-21latency_hist09:29:593
1687999140,10cyclictest12158-21cat11:00:223
1687999140,10cyclictest10555-21sh09:10:163
1687899146,6cyclictest704-21gdbus09:40:182
1687899141,9cyclictest27641-21ssh10:33:012
1687899141,9cyclictest27641-21ssh10:33:002
1687899141,9cyclictest18517-21ssh10:45:412
1687899141,9cyclictest17492-21sh10:26:592
1687899141,9cyclictest17492-21sh10:26:582
1687899141,10cyclictest2073-21runrttasks08:54:072
1687899140,10cyclictest9579-21sh11:55:082
1687899140,10cyclictest849-21ssh10:17:422
1687899140,10cyclictest8448-21ssh12:30:272
1687899140,10cyclictest800-21chrt07:40:442
1687899140,10cyclictest5976-21ssh12:10:342
1687899140,10cyclictest5328-21sh11:52:122
1687899140,10cyclictest4065-21ssh09:25:042
1687899140,10cyclictest334-21systemd-journal10:00:062
1687899140,10cyclictest31965-21ssh11:49:252
1687899140,10cyclictest31824-21runrttasks08:45:422
1687899140,10cyclictest30844-21ssh09:58:182
1687899140,10cyclictest29633-21sh12:05:482
1687899140,10cyclictest27556-21ssh09:20:022
1687899140,10cyclictest27340-21rm10:50:322
1687899140,10cyclictest26224-21chrt07:29:242
1687899140,10cyclictest25894-21rm09:19:182
1687899140,10cyclictest25807-21ssh11:26:472
1687899140,10cyclictest25075-21rm12:21:452
1687899140,10cyclictest25075-21rm12:21:442
1687899140,10cyclictest24359-21ssh12:03:202
1687899140,10cyclictest22029-21wget09:35:142
1687899140,10cyclictest21834-21cat07:20:002
1687899140,10cyclictest19865-21fschecks_time11:05:152
1687899140,10cyclictest1982-21sh10:36:302
1687899140,10cyclictest18705-21ssh11:41:072
1687899140,10cyclictest17285-21ssh09:14:262
1687899140,10cyclictest16736-21ssh11:21:352
1687899140,10cyclictest1585-21ssh11:31:212
1687899140,10cyclictest15743-21ssh09:50:032
1687899140,10cyclictest14735-21ssh10:07:192
1687899140,10cyclictest13537-21runrttasks11:01:142
1687899140,10cyclictest12702-21chrt08:07:122
1687499146,6cyclictest11008-21tr08:05:131
1687499142,9cyclictest18633-21cpuspeed12:00:121
1687499140,9cyclictest17365-21ssh12:35:341
1687499140,10cyclictest8726-21ssh10:40:181
1687499140,10cyclictest8185-21rm09:26:541
1687499140,10cyclictest8059-21ssh12:12:041
1687499140,10cyclictest785-21runrttasks10:56:191
1687499140,10cyclictest785-21runrttasks10:45:061
1687499140,10cyclictest785-21runrttasks07:11:561
1687499140,10cyclictest7285-21sh10:03:161
1687499140,10cyclictest6670-21ssh11:53:121
1687499140,10cyclictest5620-21ssh12:29:471
1687499140,10cyclictest4856-21wget09:00:121
1687499140,10cyclictest4586-21/usr/sbin/munin10:20:191
1687499140,10cyclictest3907-21ssh11:33:031
1687499140,10cyclictest31544-21rm11:11:321
1687499140,10cyclictest30651-21rm10:15:501
1687499140,10cyclictest28931-21/usr/sbin/munin07:35:161
1687499140,10cyclictest28789-21ssh11:47:071
1687499140,10cyclictest28264-21tr12:05:181
1687499140,10cyclictest25272-21/usr/sbin/munin10:50:201
1687499140,10cyclictest24222-21runrttasks07:25:061
1687499140,10cyclictest23451-21sh10:12:011
1687499140,10cyclictest21638-21cpuspeed_turbos12:20:121
1687499140,10cyclictest21638-21cpuspeed_turbos12:20:121
1687499140,10cyclictest20613-21ssh09:34:301
1687499140,10cyclictest20358-21/usr/sbin/munin08:25:151
1687499140,10cyclictest19215-21ssh09:51:261
1687499140,10cyclictest18009-21/usr/sbin/munin08:20:231
1687499140,10cyclictest16282-21ssh11:03:151
1687499140,10cyclictest15903-21wget11:40:121
1687499140,10cyclictest14521-21sh11:57:321
1687499140,10cyclictest13835-21ssh09:11:571
1687499140,10cyclictest10203-21/usr/sbin/munin10:05:251
1686999146,6cyclictest9718-21seq09:10:100
1686999146,6cyclictest704-21gdbus08:45:010
1686999146,6cyclictest704-21gdbus08:45:000
1686999146,6cyclictest11916-21ssh11:37:340
1686999145,7cyclictest19878-21sh10:46:430
1686999143,8cyclictest785-21runrttasks07:29:150
1686999141,7cyclictest10616-21latency_hist08:05:010
1686999141,11cyclictest28634-21latency_hist07:35:000
1686999141,11cyclictest17781-21cat08:20:000
1686999141,10cyclictest6523-21sh10:02:430
1686999141,10cyclictest21324-21rm11:43:030
1686999141,10cyclictest15702-21fschecks_count12:35:150
1686999140,9cyclictest785-21runrttasks09:01:000
1686999140,9cyclictest12444-21sh12:15:060
1686999140,9cyclictest12444-21sh12:15:060
1686999140,8cyclictest25290-21expr09:55:120
1686999140,12cyclictest32284-21/usr/sbin/munin10:35:200
1686999140,12cyclictest28749-21sh11:28:580
1686999140,12cyclictest22047-21sh10:30:060
1686999140,12cyclictest22047-21sh10:30:050
1686999140,12cyclictest20451-21ssh11:24:180
1686999140,12cyclictest12715-21ssh11:00:380
1686999140,10cyclictest4508-21sh10:20:060
1686999140,10cyclictest32446-21ssh12:25:440
1686999140,10cyclictest19361-21ssh10:28:230
1686999140,10cyclictest19361-21ssh10:28:220
947329131,10tAtEmLog_013682-21chrt12:34:175
906299130,10tDemoTimingTask11752-21taskset09:10:275
846229130,3tAtEmLog_015983-21chrt10:08:125
3221029130,2tAtEmLog_08631-21chrt11:35:245
1688099135,6cyclictest18337-21cpuspeed_turbos08:20:124
1688099134,7cyclictest2129-21cut10:55:134
1688099132,8cyclictest31308-21cut11:30:144
1688099131,9cyclictest9016-21runrttasks09:08:024
1688099131,8cyclictest8756-21sendmail_mailtr10:40:184
1688099131,7cyclictest1705150cat07:10:004
1688099130,9cyclictest8581-21aten2_r5power_c08:00:114
1688099130,9cyclictest785-21runrttasks08:05:034
1688099130,9cyclictest6918-21ssh11:35:074
1688099130,9cyclictest3315-21diskmemload12:10:014
1688099130,9cyclictest31530-21runrttasks07:40:014
1688099130,9cyclictest27854-21sh09:56:074
1688099130,9cyclictest27851-21runrttasks07:30:224
1688099130,9cyclictest27514-21aten2_r5power_p08:40:114
1688099130,9cyclictest27514-21aten2_r5power_p08:40:114
1688099130,9cyclictest25098-21ssh10:50:044
1688099130,9cyclictest21877-21/usr/sbin/munin07:20:124
1688099130,9cyclictest21300-21/usr/sbin/munin12:20:134
1688099130,9cyclictest21300-21/usr/sbin/munin12:20:134
1688099130,9cyclictest20890-21timerandwakeup11:05:244
1688099130,9cyclictest19759-21tr07:15:134
1688099130,9cyclictest18443-21ssh09:15:054
1688099130,9cyclictest15623-21/usr/sbin/munin08:15:124
1688099130,9cyclictest15250-21taskset08:14:104
1688099130,9cyclictest1111-21ls11:50:124
1688099130,10cyclictest737-21hddtemp_smartct08:50:144
1688099130,10cyclictest3547-21sh10:00:324
1688099130,10cyclictest31908-21runrttasks08:46:514
1688099130,10cyclictest30229-21ssh11:10:374
1688099130,10cyclictest29568-21expr07:35:144
1688099130,10cyclictest28286-21sort09:20:154
1688099130,10cyclictest26340-21switchtime08:35:224
1688099130,10cyclictest22051-21ssh10:30:064
1688099130,10cyclictest22051-21ssh10:30:064
1688099130,10cyclictest17147-21/usr/sbin/munin07:10:194
1687999130,9cyclictest4482-21sh10:20:053
1687999130,9cyclictest3958-21/usr/sbin/munin07:50:123
1687999130,9cyclictest30782-21idleruntime12:25:153
1687999130,9cyclictest25548-21grep08:35:143
1687999130,9cyclictest18009-21/usr/sbin/munin08:20:183
1687999130,10cyclictest23610-21chrt07:21:303
1687999130,10cyclictest19274-21ssh10:10:083
1687999130,10cyclictest1680-21cat11:50:143
1687899131,9cyclictest27860-21sh11:10:052
1687899130,9cyclictest8810-21python310:40:182
1687899130,9cyclictest8565-21/usr/sbin/munin08:00:202
1687899130,9cyclictest8237-21/usr/sbin/munin09:45:182
1687899130,9cyclictest808-21runintdemo5min07:47:152
1687899130,9cyclictest785-21runrttasks08:20:072
1687899130,9cyclictest5003-21processes07:50:192
1687899130,9cyclictest4822-21/usr/sbin/munin09:00:202
1687899130,9cyclictest4182-21sh11:15:032
1687899130,9cyclictest3349-21missed_timers08:55:192
1687899130,9cyclictest29492-21fschecks_time07:35:142
1687899130,9cyclictest27436-21taskset08:40:072
1687899130,9cyclictest27436-21taskset08:40:062
1687899130,9cyclictest27292-21if_enp6s007:30:152
1687899130,9cyclictest25058-21runrttasks08:35:032
1687899130,9cyclictest23639-21sleep07:21:522
1687899130,9cyclictest22763-21aten2_r5power_e08:30:112
1687899130,9cyclictest20733-21/usr/sbin/munin08:25:112
1687899130,9cyclictest2048-21/usr/sbin/munin10:55:122
1687899130,9cyclictest15915-21cpuspeed_turbos08:15:132
1687899130,9cyclictest14789-21unixbench-2d08:10:252
1687899130,9cyclictest13836-21cut12:15:192
1687899130,9cyclictest13836-21cut12:15:192
1687899130,10cyclictest7009-21sed07:55:152
1687899130,10cyclictest5371-21idleruntime10:20:152
1687899130,10cyclictest15151-21sh12:35:092
1687499132,7cyclictest20608-21kworker/u24:4+rpciod11:05:031
1687499130,9cyclictest9612-21sh11:35:521
1687499130,9cyclictest7166-21runrttasks09:05:061
1687499130,9cyclictest7094-21/usr/sbin/munin09:45:111
1687499130,9cyclictest6189-21/usr/sbin/munin07:55:151
1687499130,9cyclictest30095-21/usr/sbin/munin08:45:151
1687499130,9cyclictest29226-21taskset08:42:121
1687499130,9cyclictest29226-21taskset08:42:111
1687499130,9cyclictest28762-21memory09:20:171
1687499130,9cyclictest2862-21fschecks_count08:55:161
1687499130,9cyclictest25510-21fschecks_count08:35:131
1687499130,9cyclictest24946-21/usr/sbin/munin09:55:141
1687499130,9cyclictest23430-21ssh11:25:201
1687499130,9cyclictest22742-21aten2_r5power_c08:30:101
1687499130,9cyclictest22161-21/usr/sbin/munin10:30:231
1687499130,9cyclictest22161-21/usr/sbin/munin10:30:221
1687499130,9cyclictest21880-21apt07:20:121
1687499130,9cyclictest21611-21sh09:35:001
1687499130,9cyclictest1857-21forks07:45:141
1687499130,9cyclictest18421-21sh09:15:041
1687499130,9cyclictest15519-21latency_hist08:15:011
1687499130,9cyclictest14389-21cat10:25:171
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional