You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-03-25 - 09:04
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.

Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Characteristics of the 376 highest latencies:
System rack5slot1.osadl.org (updated Wed Mar 25, 2026 00:44:05)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
2997739920,0EcMasterDemoSyn2998929tAtEmLog_023:00:085
123139890,0EcMasterDemoSyn124129tAtEmLog_019:11:575
61662870,1sleep30-21swapper/323:58:293
658239830,0EcMasterDemoSyn659229tAtEmLog_000:16:135
3089839830,0EcMasterDemoSyn3090829tAtEmLog_023:35:395
2568139830,0EcMasterDemoSyn2569129tAtEmLog_022:39:515
1469739830,0EcMasterDemoSyn1470729tAtEmLog_020:48:175
700439820,0EcMasterDemoSyn701429tAtEmLog_022:29:425
3126739820,0EcMasterDemoSyn3127729tAtEmLog_019:06:525
3083239820,0EcMasterDemoSyn3084229tAtEmLog_021:49:085
2177139820,0EcMasterDemoSyn2178129tAtEmLog_023:30:355
2079839820,0EcMasterDemoSyn2080829tAtEmLog_019:52:305
1666739820,0EcMasterDemoSyn1667729tAtEmLog_021:59:165
1099039820,0EcMasterDemoSyn1100029tAtEmLog_019:32:135
494139810,0EcMasterDemoSyn495129tAtEmLog_020:28:015
3022939810,0EcMasterDemoSyn3023929tAtEmLog_022:24:395
288239810,0EcMasterDemoSyn289329tAtEmLog_022:09:265
1274239810,0EcMasterDemoSyn1275229tAtEmLog_023:25:295
1192139810,0EcMasterDemoSyn1193129tAtEmLog_022:14:295
1647239280,0EcMasterDemoSyn0-21swapper/522:34:475
839439210,0EcMasterDemoSyn0-21swapper/521:18:425
162922200,0sleep40-21swapper/400:21:404
2617139190,0EcMasterDemoSyn0-21swapper/522:04:215
761839180,0EcMasterDemoSyn0-21swapper/523:40:425
3160999181,13cyclictest16-1pr/legacy21:49:073
3160499181,13cyclictest16-1pr/legacy23:45:462
3159699180,14cyclictest24831-21sh21:10:090
3159699180,10cyclictest23399-21sh22:38:140
3159699180,10cyclictest18301-21sh22:17:360
2554699180,8tDemoTimingTask27876-21chrt20:07:415
2554699180,8tDemoTimingTask25588-21chrt20:02:525
125699180,8tDemoTimingTask3952-21taskset00:33:255
125699180,7tDemoTimingTask8734-21chrt00:35:255
840429170,7tAtEmLog_013506-21chrt21:20:545
31609991713,3cyclictest15097-21cron23:10:003
3160999171,13cyclictest16-1pr/legacy20:02:383
3160499179,6cyclictest30785-21wc21:30:242
3160499179,6cyclictest30785-21wc21:30:242
3160499170,14cyclictest6452-21sh21:53:302
3160099170,10cyclictest9986-21rm23:42:231
3159699172,9cyclictest24780-21aten2_r5power_v23:15:100
3159699171,12cyclictest16-1pr/legacy20:48:170
3159699170,9cyclictest7918-21sh21:35:360
3159699170,9cyclictest30826-21sh22:06:150
3159699170,9cyclictest27778-21sh22:22:500
3159699170,9cyclictest1917-21sh22:44:350
3159699170,9cyclictest18464-21sh22:00:060
3159699170,9cyclictest1497-21sh00:13:580
3159699170,9cyclictest13677-21sh00:02:210
3159699170,9cyclictest10479-21sh23:42:440
241039170,0EcMasterDemoSyn0-21swapper/522:44:555
2092999170,10tDemoTimingTask21049-21taskset22:55:075
3262499160,9tDemoTimingTask32656-21taskset20:17:555
3160099168,6cyclictest24312-21tail20:00:161
3160099161,11cyclictest21117-21/usr/sbin/munin22:55:141
3159699164,9cyclictest21163-21cat23:30:230
31596991613,2cyclictest2957-21turbostat00:19:540
3159699161,11cyclictest16-1pr/legacy20:53:200
3159699160,9cyclictest780-21runrttasks20:26:550
3159699160,9cyclictest3533-21rm21:51:250
2990739160,7EcMasterDemoSyn30653-21taskset00:11:395
256299160,9tDemoTimingTask8368-21taskset00:00:005
2316899160,10tDemoTimingTask23199-21chrt19:57:385
1839329160,7tAtEmLog_018582-21taskset19:49:385
31612991511,3cyclictest7576-21runintdemo5min21:54:154
31612991511,3cyclictest326-21systemd-journal23:20:264
31612991511,3cyclictest326-21systemd-journal23:20:254
3161299151,10cyclictest31206-21sh21:49:224
3160999154,8cyclictest5788-21wget21:35:133
3160999154,8cyclictest4830-21unixbench-2d22:45:243
3160999151,12cyclictest26781-21sh22:22:083
3160999151,10cyclictest4546-21runrttasks22:27:583
3160999151,10cyclictest3524-21/usr/sbin/munin00:15:163
3160999150,9cyclictest21080-21ssh00:06:123
3160999150,8cyclictest4565-21ssh23:21:063
3160999150,8cyclictest4565-21ssh23:21:063
3160999150,8cyclictest24367-21diskmemload22:40:413
3160999150,13cyclictest30349-21grep21:30:193
3160999150,13cyclictest30349-21grep21:30:193
3160499150,11cyclictest16-1pr/legacy21:28:512
3160099155,8cyclictest7929-21/usr/sbin/munin19:25:191
3160099155,8cyclictest7929-21/usr/sbin/munin19:25:191
3160099153,9cyclictest326-21systemd-journal20:34:321
3160099151,12cyclictest22417-21ssh21:25:451
3160099151,11cyclictest16-1pr/legacy23:20:251
3160099151,11cyclictest16-1pr/legacy23:20:241
3160099151,10cyclictest18923-21/usr/sbin/munin19:50:151
3159699157,7cyclictest31590-21cyclictest22:53:280
3159699154,8cyclictest11408-21sed23:25:170
3159699153,8cyclictest780-21runrttasks20:00:500
3159699152,9cyclictest31924-21diskmemload23:36:200
3159699150,9cyclictest23788-21sh00:08:100
3159699150,10cyclictest18185-21gltestperf20:55:130
3161299142,9cyclictest9995-21ssh22:30:254
3161299142,9cyclictest716-21snmpd21:14:204
3161299142,9cyclictest25295-21sh22:21:054
3161299141,9cyclictest8775-21sh00:35:274
3161299141,9cyclictest7843-21missed_timers23:05:174
3161299141,9cyclictest32587-21/usr/sbin/munin19:10:174
3161299141,9cyclictest30570-21sh21:30:224
3161299141,9cyclictest30570-21sh21:30:214
3161299141,9cyclictest19584-21sh21:42:334
3161299141,9cyclictest17521-21taskset20:55:074
31612991411,2cyclictest32081-21gltestperf22:25:164
31612991411,2cyclictest23381-21cron20:00:004
3161299141,10cyclictest1773-21sh23:37:564
3161299140,9cyclictest26502-21/usr/sbin/munin22:40:134
3161299140,10cyclictest9146-21ssh23:41:464
3161299140,10cyclictest780-21runrttasks19:20:114
3161299140,10cyclictest7204-21runrttasks21:35:224
3161299140,10cyclictest716-21snmpd00:30:294
3161299140,10cyclictest6561-21ssh22:10:424
3161299140,10cyclictest32295-21/usr/sbin/munin23:55:154
3161299140,10cyclictest3040-21sh23:02:494
3161299140,10cyclictest30239-21chrt20:12:484
3161299140,10cyclictest25256-21sh23:50:264
3161299140,10cyclictest24437-21sh22:56:224
3161299140,10cyclictest24328-21ssh23:32:224
3161299140,10cyclictest20450-21ssh23:48:264
3161299140,10cyclictest19955-21/usr/sbin/munin21:25:124
3161299140,10cyclictest16884-21ntp_offset23:10:194
3161299140,10cyclictest15690-21ssh22:51:374
3161299140,10cyclictest13365-21aten2_r5power_v22:15:124
3161299140,10cyclictest1329-21head20:20:154
3161299140,10cyclictest11113-21sh00:00:344
3160999146,6cyclictest326-21systemd-journal23:17:003
3160999144,8cyclictest326-21systemd-journal22:00:013
3160999143,8cyclictest720-21ntpd21:25:193
3160999143,8cyclictest326-21systemd-journal22:39:373
3160999142,9cyclictest4626-21sh23:39:583
3160999142,8cyclictest4685-21sh23:40:003
3160999141,9cyclictest30656-21df00:30:123
3160999141,9cyclictest286-21jbd2/md0-822:55:193
3160999141,9cyclictest26958-21/usr/sbin/munin00:10:183
3160999141,9cyclictest26701-21sh23:51:253
3160999141,9cyclictest21328-21/usr/sbin/munin19:55:203
3160999141,10cyclictest22366-21sh23:30:583
3160999140,8cyclictest31663-21ssh21:13:423
3160999140,7cyclictest8564-21ssh22:12:073
3160999140,10cyclictest8756-21sh00:00:033
3160999140,10cyclictest780-21runrttasks21:05:533
3160999140,10cyclictest780-21runrttasks21:01:583
3160999140,10cyclictest7795-21/usr/sbin/munin20:35:263
3160999140,10cyclictest7496-21cut19:25:143
3160999140,10cyclictest7496-21cut19:25:143
3160999140,10cyclictest7183-21ssh21:17:543
3160999140,10cyclictest6893-21/usr/sbin/munin00:35:133
3160999140,10cyclictest6011-21perl20:30:163
3160999140,10cyclictest4464-21tr19:20:133
3160999140,10cyclictest3612-21perl20:25:143
3160999140,10cyclictest3348-21ssh22:09:473
3160999140,10cyclictest31407-21uname23:00:193
3160999140,10cyclictest28860-21grep20:10:183
3160999140,10cyclictest26832-21cut20:05:173
3160999140,10cyclictest21095-21latency_hist00:25:003
3160999140,10cyclictest20281-21timerandwakeup19:50:233
3160999140,10cyclictest19218-21sh23:11:333
3160999140,10cyclictest17534-21chrt21:41:023
3160999140,10cyclictest17525-21/usr/sbin/munin20:55:213
3160999140,10cyclictest15727-21sh22:15:493
3160999140,10cyclictest14968-21taskset23:27:053
3160999140,10cyclictest13710-21sh21:21:023
3160999140,10cyclictest12988-21ssh22:50:183
3160999140,10cyclictest12935-21wget20:45:123
3160999140,10cyclictest12310-21ssh22:31:523
3160999140,10cyclictest10858-21chrt19:30:363
3160999140,10cyclictest10099-21sh21:55:173
3160499146,6cyclictest10449-21gdbus20:40:002
3160499144,8cyclictest1739-21/usr/sbin/munin23:20:132
3160499144,8cyclictest1739-21/usr/sbin/munin23:20:122
3160499143,8cyclictest755-21postgres19:10:502
3160499143,8cyclictest326-21systemd-journal19:26:322
3160499143,8cyclictest326-21systemd-journal19:26:322
3160499143,8cyclictest17940-21timerandwakeup19:45:252
3160499141,9cyclictest7749-21latency_hist20:35:002
3160499141,9cyclictest24774-21sh21:10:042
3160499141,9cyclictest18492-21missed_timers22:35:182
3160499141,9cyclictest17309-21runrttasks21:23:342
3160499141,7cyclictest15621-21/usr/sbin/munin23:10:172
3160499141,10cyclictest17623-21ssh00:22:372
3160499141,10cyclictest16-1pr/legacy21:44:032
3160499141,10cyclictest16-1pr/legacy00:16:112
3160499140,9cyclictest22883-21fschecks_time21:05:162
3160499140,11cyclictest8834-21diskmemload00:00:052
3160499140,10cyclictest9077-21sh23:41:442
3160499140,10cyclictest7982-21ssh21:35:402
3160499140,10cyclictest6409-21cat00:34:592
3160499140,10cyclictest32183-21ssh23:55:082
3160499140,10cyclictest31238-21ssh21:49:242
3160499140,10cyclictest28904-21ssh23:52:592
3160499140,10cyclictest27745-21apt-get22:05:122
3160499140,10cyclictest26759-21ssh22:04:452
3160499140,10cyclictest2419-21taskset20:20:532
3160499140,10cyclictest2415-21sh23:38:232
3160499140,10cyclictest23642-21ssh22:55:492
3160499140,10cyclictest23088-21sh23:31:292
3160499140,10cyclictest21811-21diskmemload00:06:442
3160499140,10cyclictest21212-21ssh00:25:022
3160499140,10cyclictest1803-21/usr/sbin/munin19:15:192
3160499140,10cyclictest14517-21ssh22:50:462
3160499140,10cyclictest13914-21/usr/sbin/munin19:40:132
3160499140,10cyclictest13676-21ssh23:26:082
3160499140,10cyclictest13223-21/usr/sbin/munin22:15:192
3160499140,10cyclictest12342-21ssh00:37:592
3160499140,10cyclictest10577-21sh22:13:332
3160499140,10cyclictest10150-21cat21:55:172
3160099141,9cyclictest8318-21/usr/sbin/munin22:30:201
3160099141,9cyclictest4762-21grep19:20:141
3160099141,9cyclictest32444-21ssh23:19:291
3160099141,9cyclictest24706-21ssh21:10:031
3160099141,9cyclictest20065-21sh23:12:081
3160099141,10cyclictest32575-21sh23:00:461
3160099141,10cyclictest13043-21sh21:39:151
3160099140,7cyclictest11485-21ssh23:07:281
3160099140,10cyclictest9722-21fschecks_time19:30:141
3160099140,10cyclictest9438-21sh21:19:251
3160099140,10cyclictest8904-21/usr/sbin/munin00:00:131
3160099140,10cyclictest8208-21sensors00:35:211
3160099140,10cyclictest780-21runrttasks21:00:111
3160099140,10cyclictest7648-21sh00:16:561
3160099140,10cyclictest5684-21sh23:58:081
3160099140,10cyclictest3525-21ssh21:51:241
3160099140,10cyclictest3404-21ssh00:32:551
3160099140,10cyclictest32273-21ssh22:07:171
3160099140,10cyclictest31573-21ssh22:42:381
3160099140,10cyclictest31308-21ssh22:25:101
3160099140,10cyclictest29093-21/usr/sbin/munin21:30:131
3160099140,10cyclictest29093-21/usr/sbin/munin21:30:131
3160099140,10cyclictest28496-21ssh23:35:051
3160099140,10cyclictest27097-21aten2_r5power_v00:10:141
3160099140,10cyclictest25898-21ssh21:45:361
3160099140,10cyclictest24367-21diskmemload23:30:211
3160099140,10cyclictest24367-21diskmemload21:23:191
3160099140,10cyclictest23160-21ssh23:50:061
3160099140,10cyclictest23104-21runrttasks19:57:001
3160099140,10cyclictest22754-21df22:20:121
3160099140,10cyclictest22333-21ssh22:01:381
3160099140,10cyclictest22055-21ssh00:06:551
3160099140,10cyclictest21453-21/usr/sbin/munin00:25:171
3160099140,10cyclictest18034-21ssh21:41:231
3160099140,10cyclictest17333-21ssh22:35:091
3160099140,10cyclictest16651-21ssh22:16:271
3160099140,10cyclictest14145-21ssh21:57:301
3160099140,10cyclictest14031-21sh23:26:241
3160099140,10cyclictest12498-21sh00:20:101
3160099140,10cyclictest12020-21runrttasks22:50:101
3159699146,6cyclictest4931-21sed22:45:240
3159699146,6cyclictest31563-21python323:00:200
3159699146,6cyclictest20670-21/usr/sbin/munin21:25:150
3159699145,7cyclictest27033-21sh21:46:240
3159699145,7cyclictest24472-21cat21:10:000
3159699145,7cyclictest21436-21cpuspeed_turbos22:55:120
3159699145,7cyclictest11186-21cpuspeed_turbos21:20:130
3159699143,8cyclictest19913-21atemtest21:00:120
3159699141,9cyclictest780-21runrttasks22:31:240
3159699141,11cyclictest22960-21sh00:25:230
3159699141,10cyclictest11227-21diskmemload23:07:170
3159699140,8cyclictest3730-21sh22:27:250
3159699140,7cyclictest9182-21ssh00:35:440
3159699140,7cyclictest5490-21sh21:16:420
3159699140,7cyclictest17163-21python323:10:210
3159699140,12cyclictest4648-21taskset22:10:160
3159699140,12cyclictest1749-21awk23:55:250
3159699140,10cyclictest999-21ssh21:32:030
3159699140,10cyclictest999-21ssh21:32:030
3159699140,10cyclictest780-21runrttasks23:22:050
3159699140,10cyclictest780-21runrttasks23:22:040
3159699140,10cyclictest780-21runrttasks21:42:160
3159699140,10cyclictest780-21runrttasks00:31:010
3159699140,10cyclictest26452-21sh23:51:150
3159699140,10cyclictest23310-21chrt19:59:100
3159699140,10cyclictest22112-21diskmemload23:49:340
3159699140,10cyclictest15229-21sh21:58:170
3159699140,10cyclictest1046-21grep19:10:240
2687239140,3EcMasterDemoSyn29031-21chrt21:30:095
2687239140,3EcMasterDemoSyn29031-21chrt21:30:085
2113439140,2EcMasterDemoSyn651irq_work/522:19:335
362599135,6tDemoTimingTask7831-21taskset23:23:255
362599135,6tDemoTimingTask7831-21taskset23:23:245
3161299136,6cyclictest25767-21grep23:15:164
3161299131,9cyclictest11922-21timerwakeupswit20:40:234
3161299131,9cyclictest11896-21df19:35:144
3161299130,9cyclictest780-21runrttasks19:30:084
3161299130,9cyclictest7798-21apt20:35:134
3161299130,9cyclictest6835-21/usr/sbin/munin19:25:134
3161299130,9cyclictest6835-21/usr/sbin/munin19:25:134
3161299130,9cyclictest3519-21sh00:15:134
3161299130,9cyclictest3083-21/usr/sbin/munin20:25:184
3161299130,9cyclictest2863-21sh22:45:054
3161299130,9cyclictest27607-21sh22:05:084
3161299130,9cyclictest26697-21ssh00:10:014
3161299130,9cyclictest24036-21cpuspeed_turbos20:00:144
3161299130,9cyclictest22929-21sh00:25:234
3161299130,9cyclictest22376-21diskmemload22:37:314
3161299130,9cyclictest22346-21wget21:05:144
3161299130,9cyclictest19903-21/usr/sbin/munin21:00:134
3161299130,9cyclictest18923-21/usr/sbin/munin19:50:134
3161299130,9cyclictest16915-21ssh21:23:174
3161299130,9cyclictest16561-21taskset19:45:044
3161299130,9cyclictest15171-21/usr/sbin/munin20:50:154
3161299130,9cyclictest14277-21diskstats19:40:144
3161299130,9cyclictest12820-21/usr/sbin/munin20:45:114
3161299130,8cyclictest31102-21df20:15:114
3161299130,11cyclictest20797-21ssh22:00:324
3161299130,10cyclictest27694-21users20:05:254
3161299130,10cyclictest2066-21ssh21:15:134
3161299130,10cyclictest17924-21ssh00:05:094
3161299130,10cyclictest12944-21ssh23:25:374
3161299130,10cyclictest11230-21diskmemload21:55:274
3160999131,9cyclictest630-21/usr/sbin/munin21:50:153
3160999131,8cyclictest655-21smartd19:40:083
3160999130,9cyclictest701-21/usr/sbin/munin20:20:173
3160999130,9cyclictest31301-21fschecks_time20:15:123
3160999130,9cyclictest2421-21gltestperf19:15:153
3160999130,9cyclictest17925-21awk19:45:253
3160999130,9cyclictest16492-21cat20:50:233
3160999130,9cyclictest1461-21taskset19:14:333
3160999130,9cyclictest11543-21/usr/sbin/munin19:35:143
3160999130,9cyclictest10395-21apt-key20:40:003
3160999130,10cyclictest21181-21ssh00:25:013
3160999130,10cyclictest16465-21ssh23:45:373
3160499135,6cyclictest32341-21wc22:25:182
3160499131,9cyclictest11543-21/usr/sbin/munin19:35:182
3160499131,7cyclictest23808-21/usr/sbin/munin20:00:132
3160499131,10cyclictest16-1pr/legacy19:57:342
3160499130,9cyclictest8298-21sh22:30:102
3160499130,9cyclictest780-21runrttasks23:05:122
3160499130,9cyclictest4171-21runrttasks19:20:022
3160499130,9cyclictest31834-21ntp_offset20:15:162
3160499130,9cyclictest29896-21sh23:00:042
3160499130,9cyclictest26845-21diskmemload00:10:082
3160499130,9cyclictest20666-21/usr/sbin/munin21:00:172
3160499130,9cyclictest19891-21sed19:50:172
3160499130,9cyclictest19586-21latency_hist21:00:002
3160499130,9cyclictest1668-21/usr/sbin/munin21:15:172
3160499130,9cyclictest15171-21/usr/sbin/munin20:50:192
3160499130,8cyclictest1234950kworker/u24:2+flush-9:019:30:052
3160499130,11cyclictest3786-21idleruntime20:25:162
3160499130,10cyclictest780-21runrttasks20:48:022
3160499130,10cyclictest3264-21grep22:45:122
3160499130,10cyclictest29580-21find20:10:222
3160499130,10cyclictest29282-21chrt23:17:142
3160499130,10cyclictest29179-21taskset22:40:562
3160499130,10cyclictest22306-21ssh22:20:082
3160099135,6cyclictest1253-21tune2fs20:20:151
3160099134,8cyclictest15526-21/usr/sbin/munin20:50:131
3160099130,9cyclictest8002-21cpuspeed_turbos20:35:131
3160099130,9cyclictest780-21runrttasks20:15:051
3160099130,9cyclictest780-21runrttasks19:46:131
3160099130,9cyclictest716-21snmpd20:45:171
3160099130,9cyclictest3749-21taskset19:18:381
3160099130,9cyclictest3439-21entropy22:45:131
3160099130,9cyclictest31898-21chrt19:10:121
3160099130,9cyclictest26587-21grep20:05:151
3160099130,9cyclictest24045-21chrt21:06:301
3160099130,9cyclictest15613-21taskset19:41:011
3160099130,9cyclictest13673-21cron23:45:001
3160099130,9cyclictest13144-21unixbench_singl19:35:251
3160099130,9cyclictest10668-21cpuspeed20:40:121
3160099130,11cyclictest3547-21fschecks_time20:25:141
3160099130,10cyclictest4133-21sh22:10:081
3160099130,10cyclictest29745-21switchtime20:10:261
3159699135,6cyclictest17947-21cat19:45:250
3159699130,9cyclictest780-21runrttasks20:20:180
3159699130,9cyclictest780-21runrttasks19:43:050
3159699130,9cyclictest780-21runrttasks19:31:550
3159699130,9cyclictest7067-21unixbench_singl20:30:260
3159699130,9cyclictest3542-21chrt19:16:300
3159699130,9cyclictest30778-21aten2_r5power_c20:15:090
3159699130,9cyclictest30104-21taskset20:11:000
3159699130,9cyclictest27395-21cat20:05:240
3159699130,9cyclictest13270-21runrttasks19:36:230
3159699130,9cyclictest1324-21sendmail-mta19:21:020
3159699130,7cyclictest174-1kworker/0:1H+kblockd20:40:100
3159699130,7cyclictest174-1kworker/0:1H+kblockd20:38:200
3159699130,7cyclictest14506-21ssh00:20:260
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional