You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-01-12 - 15:17
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.

Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Characteristics of the 376 highest latencies:
System rack5slot1.osadl.org (updated Mon Jan 12, 2026 12:44:06)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
3116639930,0EcMasterDemoSyn3117629tAtEmLog_007:08:415
502939920,0EcMasterDemoSyn503929tAtEmLog_008:29:485
305792880,1sleep330566-21apt-get12:30:103
2718939860,1EcMasterDemoSyn27194-21runintdemo5min09:45:534
740139840,0EcMasterDemoSyn741129tAtEmLog_011:22:135
740139840,0EcMasterDemoSyn741129tAtEmLog_011:22:135
820739830,0EcMasterDemoSyn821729tAtEmLog_010:46:445
2967439830,0EcMasterDemoSyn2968429tAtEmLog_011:52:395
2730039830,0EcMasterDemoSyn2731029tAtEmLog_010:21:225
2230439830,0EcMasterDemoSyn2231429tAtEmLog_010:36:345
1805539830,0EcMasterDemoSyn1806529tAtEmLog_012:23:045
143039830,0EcMasterDemoSyn144029tAtEmLog_007:13:445
1342939830,0EcMasterDemoSyn1343929tAtEmLog_007:39:065
350239820,0EcMasterDemoSyn351229tAtEmLog_009:15:275
3239539820,0EcMasterDemoSyn3240529tAtEmLog_008:19:405
2452139820,0EcMasterDemoSyn2453129tAtEmLog_012:07:515
1237839820,0EcMasterDemoSyn1238829tAtEmLog_011:07:015
1089439820,0EcMasterDemoSyn1090429tAtEmLog_007:34:025
403839810,0EcMasterDemoSyn404829tAtEmLog_010:26:275
379639810,0EcMasterDemoSyn380629tAtEmLog_007:18:505
236439810,0EcMasterDemoSyn237429tAtEmLog_008:24:455
2329839810,0EcMasterDemoSyn2330829tAtEmLog_009:05:185
1581439810,0EcMasterDemoSyn1582429tAtEmLog_007:44:115
892639210,1EcMasterDemoSyn8933-21grep12:18:001
2730039210,1EcMasterDemoSyn27306-21ps10:21:220
198882210,0sleep20-21swapper/209:42:202
3137399196,9cyclictest5897-21sh10:27:450
3137399180,14cyclictest8183-21sh10:10:440
3137399180,10cyclictest31851-21sh11:54:100
3137399180,10cyclictest10915-21sh11:24:420
3137399180,10cyclictest10915-21sh11:24:420
119299181,10tDemoTimingTask1216-21chrt12:12:575
842739170,0EcMasterDemoSyn0-21swapper/509:35:445
3138599170,10cyclictest26657-21sh10:04:043
3137799170,9cyclictest19853-21rm09:42:181
3137399179,6cyclictest18621-21grep11:10:200
3137399170,9cyclictest27362-21sh12:28:070
3137399170,9cyclictest18844-21grep10:35:120
3137399170,9cyclictest17550-21ssh12:22:450
3137399170,14cyclictest2418-21sh11:01:210
3003529170,10tAtEmLog_030142-21chrt08:15:015
2720099170,10tDemoTimingTask27215-21chrt09:45:535
2565629170,7tAtEmLog_027442-21chrt11:33:375
234629170,10tAtEmLog_05880-21taskset11:39:565
3139099164,9cyclictest744-21snmpd12:13:464
3138599161,12cyclictest16-1pr/legacy11:22:123
3138599161,12cyclictest16-1pr/legacy11:22:113
3138299165,8cyclictest648-21systemd-logind08:05:212
3138299160,9cyclictest9163-21sh11:05:172
3137799164,9cyclictest327-21systemd-journal07:12:371
3137399160,14cyclictest6366-21ps11:57:430
3137399160,13cyclictest14651-21runrttasks11:44:460
2058929160,6tAtEmLog_020639-21taskset07:54:385
3139099154,8cyclictest327-21systemd-journal08:07:004
3139099152,9cyclictest16591-21entropy07:45:134
3139099151,10cyclictest831-21runrttasks07:24:424
3139099150,9cyclictest18168-21latency11:10:174
3139099150,11cyclictest16-1pr/legacy10:01:044
3138599155,8cyclictest14691-21/usr/sbin/munin07:40:173
3138599155,7cyclictest760-21lldpd09:54:443
3138599154,6cyclictest28956-21netstat10:40:193
3138599153,9cyclictest744-21snmpd11:02:283
3138599152,9cyclictest744-21snmpd08:12:273
3138599151,11cyclictest16-1pr/legacy09:10:223
3138599151,10cyclictest7630-21threads09:35:233
3138599151,10cyclictest4383-21/usr/sbin/munin10:45:233
3138599150,9cyclictest5101-21ssh11:56:493
3138599150,9cyclictest25471-21rm11:50:163
3138599150,9cyclictest13878-21sh12:01:423
3138599150,9cyclictest13062-21sh11:43:383
3138599150,8cyclictest23466-21sh10:37:223
3138599150,11cyclictest19866-21/usr/sbin/munin09:25:123
3138599150,11cyclictest19866-21/usr/sbin/munin09:25:113
3138599150,11cyclictest16685-21chrt08:53:113
3138599150,10cyclictest6865-21ssh12:16:323
3138599150,10cyclictest569-21/usr/sbin/munin10:25:173
3138299152,9cyclictest9116-21sh12:35:242
3138299150,8cyclictest5339-21sh11:20:462
3138299150,8cyclictest5339-21sh11:20:462
3138299150,12cyclictest12081-21readlink09:20:192
3138299150,10cyclictest2152-21ssh10:08:012
3138299150,10cyclictest11997-21basename07:35:162
3137799153,9cyclictest744-21snmpd11:00:431
31377991511,3cyclictest21984-21needreboot07:55:171
3137799151,10cyclictest831-21runrttasks08:14:071
3137799151,10cyclictest32747-21sh12:12:201
3137799150,9cyclictest18904-21ssh11:28:561
3137799150,11cyclictest29599-21sh09:47:321
3137799150,11cyclictest29548-21rm11:16:221
3137799150,11cyclictest29548-21rm11:16:221
3137799150,10cyclictest831-21runrttasks08:40:421
3137399151,7cyclictest831-21runrttasks08:05:250
3137399151,6cyclictest9865-21cat09:55:010
3137399151,10cyclictest22905-21sh10:55:120
3137399150,8cyclictest832-21latency_hist09:50:010
3137399150,8cyclictest805-21postgres11:16:110
3137399150,8cyclictest805-21postgres11:16:110
3137399150,8cyclictest6588-21chrt09:17:300
3137399150,13cyclictest15092-21sort10:15:120
3068499150,9tDemoTimingTask30704-21taskset11:17:105
3068499150,9tDemoTimingTask30704-21taskset11:17:095
2531239150,4EcMasterDemoSyn25320-21grep08:04:282
1651499150,9tDemoTimingTask16523-21taskset11:27:185
3139099147,5cyclictest10990-21sort09:55:164
3139099146,6cyclictest9362-21tune2fs07:30:144
3139099146,6cyclictest24393-21grep10:55:234
3139099146,6cyclictest1041-21grep07:10:224
3139099142,9cyclictest16616-21python309:40:214
3139099141,9cyclictest963-21sh09:15:004
3139099141,9cyclictest26035-21sh10:20:284
3139099141,9cyclictest19337-21latency_hist09:25:004
3139099141,9cyclictest11596-21latency_hist11:25:014
3139099141,9cyclictest11596-21latency_hist11:25:014
3139099141,9cyclictest11149-21sh11:42:184
31390991411,2cyclictest0-21swapper/411:10:004
3139099141,10cyclictest6337-21missed_timers08:30:194
3139099141,10cyclictest16-1pr/legacy09:25:354
3139099141,10cyclictest16-1pr/legacy09:25:354
3139099140,12cyclictest4239-21kworker/4:2+events10:25:174
3139099140,11cyclictest21347-21kworker/u24:1+rpciod09:36:394
3139099140,10cyclictest8745-21rm10:11:084
3139099140,10cyclictest831-21runrttasks10:42:194
3139099140,10cyclictest7581-21sh10:46:184
3139099140,10cyclictest3804-21sh11:55:544
3139099140,10cyclictest28963-21ssh09:30:104
3139099140,10cyclictest23406-21sh10:37:194
3139099140,10cyclictest2015-21ssh11:19:474
3139099140,10cyclictest2015-21ssh11:19:474
3139099140,10cyclictest18969-21cstates07:50:124
3139099140,10cyclictest16807-21sh11:45:194
3139099140,10cyclictest14287-21fschecks_count07:40:154
3139099140,10cyclictest1354-21ssh09:15:034
3139099140,10cyclictest1185-21sh11:00:284
3139099140,10cyclictest11211-21open_files08:40:204
3138599147,6cyclictest2731-21strings09:15:203
3138599141,9cyclictest7755-21rm10:10:273
3138599141,9cyclictest31582-21chrt09:30:493
3138599141,9cyclictest2479-21diskmemload10:08:153
3138599141,10cyclictest26238-21/usr/sbin/munin11:15:183
3138599141,10cyclictest26238-21/usr/sbin/munin11:15:183
3138599141,10cyclictest23890-21ssh12:25:373
3138599140,9cyclictest30406-21/usr/sbin/munin08:15:143
3138599140,10cyclictest831-21runrttasks09:21:293
3138599140,10cyclictest5399-21/usr/sbin/munin08:30:133
3138599140,10cyclictest4683-21users08:25:233
3138599140,10cyclictest4120-21cat07:20:013
3138599140,10cyclictest32534-21ssh11:35:523
3138599140,10cyclictest28076-21/usr/sbin/munin12:10:133
3138599140,10cyclictest27734-21runrttasks08:09:543
3138599140,10cyclictest25998-21ssh10:56:303
3138599140,10cyclictest25004-21cat09:45:143
3138599140,10cyclictest24344-21df10:20:113
3138599140,10cyclictest22493-21ssh12:06:253
3138599140,10cyclictest21787-21cat09:05:003
3138599140,10cyclictest21100-21/usr/sbin/munin11:30:133
3138599140,10cyclictest20854-21sh09:42:593
3138599140,10cyclictest19873-21ssh11:10:533
3138599140,10cyclictest19230-21sh09:00:003
3138599140,10cyclictest17426-21basename07:45:203
3138599140,10cyclictest16741-21unixbench_multi10:15:263
3138599140,10cyclictest16704-21/usr/sbin/munin11:45:183
3138599140,10cyclictest15898-21ssh12:21:343
3138599140,10cyclictest14619-21rm11:08:353
3138599140,10cyclictest14112-21ssh12:38:573
3138599140,10cyclictest11727-21ssh11:25:043
3138599140,10cyclictest11315-21/usr/sbin/munin07:35:253
3138599140,10cyclictest10324-21chrt09:55:113
3138599140,10cyclictest10048-21df10:30:133
3138299141,9cyclictest30569-21sh11:35:142
3138299141,9cyclictest12428-21sed08:50:042
3138299141,10cyclictest744-21snmpd10:21:002
3138299141,10cyclictest16-1pr/legacy09:05:182
3138299140,9cyclictest831-21runrttasks10:46:292
3138299140,9cyclictest29882-21interrupts09:30:172
3138299140,9cyclictest11220-21latency_hist07:35:002
3138299140,11cyclictest744-21snmpd08:36:042
3138299140,11cyclictest31514-21rm11:00:092
3138299140,10cyclictest8310-21sh11:59:052
3138299140,10cyclictest744-21snmpd07:49:522
3138299140,10cyclictest744-21snmpd07:18:272
3138299140,10cyclictest569-21/usr/sbin/munin10:25:142
3138299140,10cyclictest323-21ssh11:18:372
3138299140,10cyclictest323-21ssh11:18:372
3138299140,10cyclictest31210-21perl12:30:122
3138299140,10cyclictest28054-21/usr/sbin/munin08:10:102
3138299140,10cyclictest28007-21ssh12:10:072
3138299140,10cyclictest26222-21ssh12:27:182
3138299140,10cyclictest26113-21wc11:50:232
3138299140,10cyclictest25561-21ssh11:32:192
3138299140,10cyclictest25464-21sh10:38:472
3138299140,10cyclictest23710-21ssh11:13:342
3138299140,10cyclictest20973-21cmp12:25:002
3138299140,10cyclictest19501-21/usr/sbin/munin10:00:252
3138299140,10cyclictest18496-21diskmemload11:28:392
3138299140,10cyclictest15581-21rm10:50:332
3138299140,10cyclictest15103-21ssh09:57:212
3138299140,10cyclictest14743-21ssh10:32:352
3138299140,10cyclictest1369-21ssh10:43:152
3138299140,10cyclictest13141-21ssh11:43:402
3137799145,7cyclictest24985-21/usr/sbin/munin11:50:131
3137799143,6cyclictest19815-21systemctl07:50:191
3137799141,9cyclictest9585-21runrttasks08:37:521
3137799141,9cyclictest29411-21ssh09:30:141
3137799141,9cyclictest27570-21runrttasks10:40:031
3137799141,9cyclictest22085-21apt-key09:05:011
3137799140,9cyclictest31842-21ssh12:30:171
3137799140,10cyclictest9540-21ssh11:41:091
3137799140,10cyclictest831-21runrttasks12:06:421
3137799140,10cyclictest831-21runrttasks09:37:371
3137799140,10cyclictest5768-21/usr/sbin/munin10:10:201
3137799140,10cyclictest569-21/usr/sbin/munin10:25:251
3137799140,10cyclictest3095-21cut08:25:111
3137799140,10cyclictest30406-21/usr/sbin/munin08:15:181
3137799140,10cyclictest2863-21ssh10:08:321
3137799140,10cyclictest27663-21ssh10:04:471
3137799140,10cyclictest24596-21sh10:55:301
3137799140,10cyclictest23744-21ssh10:20:021
3137799140,10cyclictest23400-21ssh11:13:221
3137799140,10cyclictest2325-21cat09:50:151
3137799140,10cyclictest21910-21ssh10:36:181
3137799140,10cyclictest21471-21runrttasks09:03:181
3137799140,10cyclictest21295-21apt-config12:25:001
3137799140,10cyclictest20964-21/usr/sbin/munin11:30:121
3137799140,10cyclictest20296-21ssh10:17:491
3137799140,10cyclictest19866-21/usr/sbin/munin09:25:191
3137799140,10cyclictest19866-21/usr/sbin/munin09:25:181
3137799140,10cyclictest19207-21ssh10:53:031
3137799140,10cyclictest1875-21/usr/sbin/munin07:15:191
3137799140,10cyclictest18620-21ssh09:59:481
3137799140,10cyclictest18318-21cat10:34:591
3137799140,10cyclictest18264-21sh11:45:551
3137799140,10cyclictest16343-21ssh09:22:571
3137799140,10cyclictest14829-21apt-get08:50:111
3137799140,10cyclictest13433-21ssh12:01:231
3137799140,10cyclictest12476-21apt-get08:45:111
3137799140,10cyclictest12233-21/usr/sbin/munin12:20:131
3137799140,10cyclictest10495-21sh10:48:191
3137399145,7cyclictest12471-21ssh12:37:490
3137399143,8cyclictest23363-21processes09:05:190
3137399143,8cyclictest11845-21grep09:20:170
3137399143,6cyclictest5158-21apt-get09:35:010
3137399142,9cyclictest9000-21grep07:30:120
3137399141,9cyclictest25242-21runrttasks08:03:390
3137399141,6cyclictest15063-21cpuspeed_turbos08:50:120
3137399140,9cyclictest20807-21mailstats09:00:190
3137399140,7cyclictest21556-21uniq11:30:150
3137399140,12cyclictest29452-21fschecks_time10:05:140
3137399140,12cyclictest25300-21ssh12:08:230
3137399140,12cyclictest24259-21diskmemload09:40:120
3137399140,12cyclictest21967-21grep07:55:170
3137399140,12cyclictest21799-21ssh10:00:410
3137399140,12cyclictest16997-21sensors_volt11:45:200
3137399140,12cyclictest13959-21sh11:25:280
3137399140,12cyclictest10101-21cut10:30:140
3137399140,10cyclictest9923-21sh12:18:410
3137399140,10cyclictest831-21runrttasks10:45:340
3137399140,10cyclictest831-21runrttasks08:56:200
3137399140,10cyclictest831-21runrttasks07:20:300
3137399140,10cyclictest4112-21grep08:25:180
3137399140,10cyclictest30611-21ssh10:41:030
3137399140,10cyclictest29824-21ssh11:35:070
3137399140,10cyclictest29165-21grep09:30:130
3137399140,10cyclictest22601-21ssh09:25:550
3137399140,10cyclictest22601-21ssh09:25:550
3137399140,10cyclictest2156-21ssh12:31:500
3137399140,10cyclictest20041-21timerandwakeup07:50:230
3137399140,10cyclictest18153-21runrttasks07:48:270
3137399140,10cyclictest17241-21sh09:58:530
3137399140,10cyclictest13415-21ssh10:50:100
3137399140,10cyclictest13050-21sh11:07:270
3137399140,10cyclictest10998-21if_err_enp5s012:00:170
3139099139,3cyclictest31780-21ntp_offset12:30:164
3139099139,3cyclictest10628-21fschecks_count12:00:144
3139099135,6cyclictest21555-21fw_packets07:55:154
3139099133,6cyclictest28585-21fschecks_time08:10:134
3139099131,9cyclictest7748-21/usr/sbin/munin08:35:124
3139099131,9cyclictest24340-21grep08:00:174
3139099130,9cyclictest9324-21runrttasks12:35:344
3139099130,9cyclictest831-21runrttasks07:25:074
3139099130,9cyclictest831-21runrttasks07:25:064
3139099130,9cyclictest5001-21diskmemload12:15:134
3139099130,9cyclictest3240-21ssh09:50:264
3139099130,9cyclictest30404-21runrttasks08:15:094
3139099130,9cyclictest29866-21diskmemload11:35:084
3139099130,9cyclictest25015-21ssh11:50:134
3139099130,9cyclictest2434-21latency_hist08:25:004
3139099130,9cyclictest24256-21ssh11:31:224
3139099130,9cyclictest23580-21sed09:05:224
3139099130,9cyclictest21612-21/usr/sbin/munin12:25:194
3139099130,9cyclictest18894-21chrt12:05:004
3139099130,9cyclictest17287-21cpu08:55:134
3139099130,9cyclictest14830-21/usr/sbin/munin10:15:214
3139099130,9cyclictest14827-21/usr/sbin/munin08:50:104
3139099130,9cyclictest11664-21sh11:25:024
3139099130,9cyclictest11315-21/usr/sbin/munin07:35:184
3139099130,10cyclictest831-21runrttasks10:30:124
3139099130,10cyclictest831-21runrttasks08:45:174
3139099130,10cyclictest831-21runrttasks07:15:064
3139099130,10cyclictest3021-21apt-get08:25:004
3139099130,10cyclictest28667-21sh10:05:034
3139099130,10cyclictest21487-21chrt09:03:334
3139099130,10cyclictest15351-21seq12:21:114
3139099130,10cyclictest13455-21rm10:50:124
3138599131,9cyclictest9495-21taskset08:36:393
3138599130,9cyclictest831-21runrttasks07:58:483
3138599130,9cyclictest7011-21fschecks_count07:25:153
3138599130,9cyclictest7011-21fschecks_count07:25:153
3138599130,9cyclictest31841-21apt-key07:10:003
3138599130,9cyclictest24411-21ntpq08:00:183
3138599130,9cyclictest18628-21/usr/sbin/munin07:50:113
3138599130,9cyclictest13241-21grep08:45:173
3138599130,10cyclictest9322-21chrt07:30:133
3138599130,10cyclictest4301-21aten2_r5power_e07:20:113
3138599130,10cyclictest390-21grep08:20:113
3138599130,10cyclictest22201-21runrttasks09:05:063
3138599130,10cyclictest13439-21/usr/sbin/munin10:50:193
31382991310,2cyclictest6322-21fschecks_time10:10:132
3138299130,9cyclictest831-21runrttasks07:58:172
3138299130,9cyclictest744-21snmpd07:50:072
3138299130,9cyclictest3241-21cpuspeed_turbos08:25:122
3138299130,9cyclictest31931-21/usr/sbin/munin07:10:182
3138299130,9cyclictest31318-21latency_hist07:10:002
3138299130,9cyclictest30978-21tune2fs08:15:142
3138299130,9cyclictest26758-21runintdemo5min09:10:242
3138299130,9cyclictest25011-21ssh10:55:482
3138299130,9cyclictest2344-21taskset08:24:362
3138299130,9cyclictest2056-21fschecks_count09:15:152
3138299130,9cyclictest19144-21/usr/sbin/munin12:05:182
3138299130,9cyclictest17160-21/usr/sbin/munin08:55:132
3138299130,9cyclictest15719-21/usr/sbin/munin10:15:172
3138299130,9cyclictest15333-21sh11:45:022
3138299130,9cyclictest13867-21/usr/sbin/munin07:40:112
3138299130,9cyclictest13008-21fschecks_time08:45:142
3138299130,9cyclictest10132-21rm12:00:102
3138299130,9cyclictest10123-21/usr/sbin/munin08:40:132
3138299130,10cyclictest8058-21timerwakeupswit07:25:252
3138299130,10cyclictest8058-21timerwakeupswit07:25:252
3138299130,10cyclictest6359-21needreboot08:30:192
3138299130,10cyclictest5988-21/usr/sbin/munin09:35:172
3138299130,10cyclictest4918-21ssh12:15:082
3138299130,10cyclictest4833-21fw_packets07:20:142
3138299130,10cyclictest26631-21ssh09:45:302
3138299130,10cyclictest23888-21rm09:26:492
3138299130,10cyclictest23888-21rm09:26:482
3138299130,10cyclictest21272-21chrt09:00:362
3138299130,10cyclictest1668-21rm09:50:122
3137799131,9cyclictest9130-21latency11:05:171
3137799131,9cyclictest7130-21taskset12:35:081
3137799131,9cyclictest6838-21timerwakeupswit08:30:251
3137799130,9cyclictest8965-21/usr/sbin/munin07:30:121
3137799130,9cyclictest6610-21/usr/sbin/munin07:25:251
3137799130,9cyclictest6610-21/usr/sbin/munin07:25:251
3137799130,9cyclictest5200-21ssh11:20:411
3137799130,9cyclictest5200-21ssh11:20:411
3137799130,9cyclictest324-21/usr/sbin/munin08:20:121
3137799130,9cyclictest31742-21unixbench_multi11:35:231
3137799130,9cyclictest2875-21sh09:15:211
3137799130,9cyclictest27498-21chrt08:07:191
3137799130,9cyclictest24594-21runrttasks08:00:201
3137799130,9cyclictest24259-21diskmemload09:10:071
3137799130,9cyclictest19271-21idleruntime-cro09:00:001
3137799130,9cyclictest16225-21/usr/sbin/munin07:45:141
3137799130,9cyclictest13867-21/usr/sbin/munin07:40:121
3137799130,9cyclictest1134-21/usr/sbin/munin11:55:161
3137799130,9cyclictest11315-21/usr/sbin/munin07:35:121
3137799130,10cyclictest5020-21kernelversion07:20:161
3137399135,6cyclictest2043-21/usr/sbin/munin07:15:130
3137399134,5cyclictest1021-21head08:20:130
3137399132,6cyclictest31399-21latency_hist07:09:590
3137399130,9cyclictest9009-21python308:35:190
3137399130,9cyclictest831-21runrttasks08:10:490
3137399130,9cyclictest744-21snmpd07:35:400
3137399130,9cyclictest28005-21sh12:10:070
3137399130,9cyclictest13956-21grep07:40:120
3137399130,12cyclictest175-1kworker/0:1H+kblockd07:25:040
3137399130,12cyclictest175-1kworker/0:1H+kblockd07:25:030
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional