You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2025-12-20 - 13:00
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.

Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Characteristics of the 376 highest latencies:
System rack5slot1.osadl.org (updated Sat Dec 20, 2025 00:44:05)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
24502391040,0EcMasterDemoSyn0-21swapper/221:51:142
262402950,0sleep50-21swapper/500:15:145
55532940,0sleep00-21swapper/022:51:420
1956239900,1EcMasterDemoSyn19569-21runintdemo5min23:17:260
2138839840,0EcMasterDemoSyn2139829tAtEmLog_020:25:035
721439830,0EcMasterDemoSyn722429tAtEmLog_021:00:325
466439830,0EcMasterDemoSyn467429tAtEmLog_000:03:055
3220939830,0EcMasterDemoSyn3221929tAtEmLog_019:39:245
2948739830,0EcMasterDemoSyn2949729tAtEmLog_020:40:165
2003639830,0EcMasterDemoSyn2004629tAtEmLog_019:14:045
453539820,0EcMasterDemoSyn454529tAtEmLog_019:49:335
2937839820,0EcMasterDemoSyn2938829tAtEmLog_022:11:315
2483339820,0EcMasterDemoSyn2484329tAtEmLog_019:24:125
1882839820,0EcMasterDemoSyn1883829tAtEmLog_023:52:565
1371439820,0EcMasterDemoSyn1372429tAtEmLog_000:08:095
2985239810,0EcMasterDemoSyn2986229tAtEmLog_019:34:205
2719039810,0EcMasterDemoSyn2720029tAtEmLog_019:29:165
222072340,1sleep022206-21ps22:25:200
127222280,0sleep20-21swapper/222:20:152
278142270,0sleep00-21swapper/023:40:090
218139260,0EcMasterDemoSyn0-21swapper/119:44:291
1634539250,0EcMasterDemoSyn0-21swapper/120:14:541
1784599181,13cyclictest16-1pr/legacy00:33:302
1783799180,17cyclictest717-21in:imuxsock22:45:190
1783799180,14cyclictest4649-21sh21:40:340
1783799180,10cyclictest744-21snmpd23:48:380
1783799180,10cyclictest744-21snmpd23:48:380
1783799180,10cyclictest20197-21sh22:06:330
1783799180,10cyclictest14889-21sh21:29:560
690499170,7tDemoTimingTask9019-21chrt19:56:415
2645899170,9tDemoTimingTask19699-21sleep00:34:555
1784299171,12cyclictest16-1pr/legacy20:55:261
1783799175,9cyclictest831-21runrttasks20:00:410
1783799175,9cyclictest831-21runrttasks20:00:410
1783799174,7cyclictest14-21ksoftirqd/023:23:300
1783799173,7cyclictest14-21ksoftirqd/000:12:260
1783799171,7cyclictest14-21ksoftirqd/023:39:350
1783799170,9cyclictest831-21runrttasks20:29:160
1783799170,9cyclictest30558-21sh21:55:100
1783799170,9cyclictest18821-21sh21:31:150
1783799170,9cyclictest17532-21sh22:23:030
1783799170,9cyclictest16215-21sh23:33:330
1783799170,8cyclictest17579-21runintdemo5min00:28:300
1783799170,14cyclictest18769-21diskmemload23:52:540
1783799170,14cyclictest12061-21ssh22:37:420
1528029170,10tAtEmLog_019224-21taskset22:59:555
690499160,6tDemoTimingTask6948-21chrt19:54:525
1785099160,9cyclictest6402-21cat21:00:183
1785099160,9cyclictest12036-21sh21:10:223
1785099160,10cyclictest25445-21rm23:38:413
1784299169,5cyclictest1640-21awk21:40:001
17842991610,5cyclictest11196-21wc23:30:201
1783799165,6cyclictest11326-21postgres21:10:160
1783799164,6cyclictest1044-21cpuspeed_turbos23:25:150
1783799160,12cyclictest13355-21cut21:45:200
623839150,2EcMasterDemoSyn6250-21taskset22:16:355
1785499151,11cyclictest16-1pr/legacy19:44:284
1785499150,6cyclictest7786-21ssh21:42:414
1785099153,9cyclictest754-21ntpd22:02:373
17850991511,3cyclictest25564-21cpuspeed_turbos21:35:143
1785099151,10cyclictest8404-21ssh22:53:413
1785099151,10cyclictest4092-21ssh23:26:233
1785099151,10cyclictest28674-21ssh23:58:303
1785099151,10cyclictest19089-21/usr/sbin/munin20:20:203
1785099151,10cyclictest14784-21ssh22:56:493
1785099150,14cyclictest25275-21munin-plugin-st00:15:003
1784599151,10cyclictest831-21runrttasks21:06:252
1784599151,10cyclictest24126-21runintdemo5min23:37:442
1784599150,9cyclictest19790-21ssh22:06:182
1784599150,8cyclictest14744-21ssh22:56:472
1784599150,11cyclictest29150-21python319:30:192
1784599150,11cyclictest13479-21sh22:03:152
1784299156,7cyclictest9897-21grep20:00:131
1784299156,7cyclictest9897-21grep20:00:131
1784299153,9cyclictest744-21snmpd00:22:241
1784299153,8cyclictest744-21snmpd22:42:241
17842991511,3cyclictest9325-21sendmail20:00:001
1784299151,10cyclictest831-21runrttasks19:29:291
1784299150,9cyclictest831-21runrttasks23:39:151
1784299150,9cyclictest31775-21ssh23:05:581
1784299150,9cyclictest29420-21sh22:11:331
1784299150,9cyclictest1341-21sh00:37:231
1784299150,11cyclictest15373-21sh23:50:281
1783799155,2cyclictest171rcu_preempt22:30:150
1783799154,8cyclictest11981-21sed22:55:190
1783799154,7cyclictest14-21ksoftirqd/000:04:020
1783799154,6cyclictest2807-21expr19:45:140
1783799154,6cyclictest11330-21kworker/u24:3+writeback21:23:210
1783799153,8cyclictest14-21ksoftirqd/000:07:300
1783799153,7cyclictest14-21ksoftirqd/023:02:360
1783799153,7cyclictest14-21ksoftirqd/021:35:270
1783799151,12cyclictest28092-21sh21:19:350
1783799150,9cyclictest7672-21diskmemload22:17:340
987929140,3tAtEmLog_011304-21chrt23:48:585
987929140,3tAtEmLog_011304-21chrt23:48:575
1785499146,6cyclictest28318-21df_inode23:40:144
1785499146,6cyclictest11026-21ntpq23:30:204
1785499144,7cyclictest357-21systemd-udevd21:32:174
1785499143,8cyclictest357-21systemd-udevd20:12:174
1785499143,8cyclictest21140-21netstat23:00:194
1785499142,9cyclictest32016-21sh22:13:204
1785499142,9cyclictest30495-21smartctl23:05:224
1785499141,9cyclictest799-21/usr/sbin/munin20:50:164
1785499141,9cyclictest32141-21runintdemo5min20:45:204
1785499141,9cyclictest30200-21unixbench_singl20:40:224
1785499141,10cyclictest26649-21taskset22:28:014
1785499140,9cyclictest30054-21latency_hist19:35:004
1785499140,10cyclictest831-21runrttasks21:07:554
1785499140,10cyclictest5537-21ssh00:03:414
1785499140,10cyclictest4990-21sh22:15:444
1785499140,10cyclictest30967-21ssh21:55:134
1785499140,10cyclictest25620-21fschecks_count19:25:144
1785499140,10cyclictest22868-21ssh22:08:214
1785499140,10cyclictest22864-21sh23:36:534
1785499140,10cyclictest22388-21sh00:30:344
1785499140,10cyclictest20459-21/usr/sbin/munin19:15:204
1785499140,10cyclictest17821-21sh21:48:004
1785499140,10cyclictest1753-21/usr/sbin/munin22:50:234
1785499140,10cyclictest14116-21sh22:20:414
1785499140,10cyclictest14030-21sh00:08:224
1785499140,10cyclictest12500-21ssh23:49:494
1785499140,10cyclictest12500-21ssh23:49:484
1785499140,10cyclictest1146-21ssh00:37:164
1785499140,10cyclictest11243-21grep20:00:254
1785499140,10cyclictest11243-21grep20:00:254
1785099146,6cyclictest327-21systemd-journal00:30:113
1785099143,8cyclictest17170-21fschecks_time20:15:163
1785099142,9cyclictest17144-21swap21:30:243
1785099141,9cyclictest6038-21sh21:41:293
1785099141,9cyclictest323-21ssh00:18:563
1785099141,9cyclictest16093-21runrttasks20:11:343
1785099141,10cyclictest2569-21/usr/sbin/munin19:45:213
17850991410,3cyclictest6029-21sh21:59:293
1785099140,9cyclictest20916-21/usr/sbin/munin22:25:193
1785099140,9cyclictest1454-21ssh23:07:253
1785099140,7cyclictest6912-21/usr/sbin/munin21:25:153
1785099140,10cyclictest9756-21sh23:47:483
1785099140,10cyclictest9756-21sh23:47:483
1785099140,10cyclictest9688-21taskset21:06:393
1785099140,10cyclictest9681-21ssh23:30:073
1785099140,10cyclictest9207-21ssh23:11:323
1785099140,10cyclictest8040-21sh22:35:203
1785099140,10cyclictest7271-21/usr/sbin/munin19:55:173
1785099140,10cyclictest3684-21/usr/sbin/munin00:20:203
1785099140,10cyclictest32142-21runrttasks19:38:383
1785099140,10cyclictest31709-21cpuspeed_turbos00:00:133
1785099140,10cyclictest31467-21ssh22:30:213
1785099140,10cyclictest30902-21switchtime21:20:223
1785099140,10cyclictest29759-21hddtemp_smartct00:35:153
1785099140,10cyclictest28775-21sh23:22:183
1785099140,10cyclictest28167-21chrt20:39:403
1785099140,10cyclictest28061-21ssh21:53:403
1785099140,10cyclictest28029-21ssh22:10:373
1785099140,10cyclictest27910-21/usr/sbin/munin23:40:133
1785099140,10cyclictest25240-21/usr/sbin/munin19:25:153
1785099140,10cyclictest24840-21ssh22:45:013
1785099140,10cyclictest24692-21ssh21:17:163
1785099140,10cyclictest22887-21/usr/sbin/munin19:20:233
1785099140,10cyclictest22605-21proc_pri20:25:193
1785099140,10cyclictest19949-21/usr/sbin/munin23:00:153
1785099140,10cyclictest16532-21/usr/sbin/munin22:05:123
1785099140,10cyclictest15954-21/usr/sbin/munin22:40:123
1785099140,10cyclictest15565-21sh23:15:193
1785099140,10cyclictest14114-21idleruntime23:50:163
1785099140,10cyclictest14059-21ssh22:20:393
1784599141,9cyclictest831-21runrttasks21:19:202
1784599141,9cyclictest3359-21sh23:44:362
1784599141,8cyclictest13336-21/usr/sbin/munin23:50:122
1784599141,10cyclictest831-21runrttasks20:55:302
1784599141,10cyclictest7959-21/usr/sbin/munin00:05:192
1784599140,10cyclictest9645-21/usr/sbin/munin20:00:192
1784599140,10cyclictest9645-21/usr/sbin/munin20:00:192
1784599140,10cyclictest831-21runrttasks22:17:372
1784599140,10cyclictest772-21seq19:40:152
1784599140,10cyclictest6585-21ssh21:41:512
1784599140,10cyclictest4477-21/usr/sbin/munin23:45:132
1784599140,10cyclictest4477-21/usr/sbin/munin23:45:132
1784599140,10cyclictest330-21ssh23:06:412
1784599140,10cyclictest31656-21rm22:30:242
1784599140,10cyclictest31505-21python319:35:232
1784599140,10cyclictest30561-21/usr/sbin/munin21:55:172
1784599140,10cyclictest30275-21chrt20:41:042
1784599140,10cyclictest28736-21taskset22:11:062
1784599140,10cyclictest27148-21runrttasks19:28:522
1784599140,10cyclictest25804-21/usr/sbin/munin00:15:222
1784599140,10cyclictest25443-21proc_pri23:20:192
1784599140,10cyclictest24328-21sh23:55:262
1784599140,10cyclictest23245-21ssh23:01:202
1784599140,10cyclictest21137-21ssh00:12:042
1784599140,10cyclictest20748-21chrt20:20:302
1784599140,10cyclictest19784-21runrttasks19:10:452
1784599140,10cyclictest19597-21ssh23:17:282
1784599140,10cyclictest18622-21rm21:48:332
1784599140,10cyclictest15765-21ssh22:40:052
1784599140,10cyclictest14014-21ps20:09:522
1784599140,10cyclictest12813-21ssh21:10:382
1784599140,10cyclictest11556-21ssh23:13:092
1784599140,10cyclictest11092-21ssh22:37:032
1784299149,3cyclictest24084-21tr20:30:141
1784299142,8cyclictest30964-21wget20:45:121
1784299141,9cyclictest22711-21ssh22:25:251
1784299141,9cyclictest16957-21sh23:15:361
1784299141,9cyclictest1567-21runrttasks00:00:521
17842991410,3cyclictest6784-21sh22:00:001
1784299140,9cyclictest6076-21sort21:00:151
1784299140,9cyclictest22887-21/usr/sbin/munin19:20:131
1784299140,9cyclictest15905-21ssh22:21:551
1784299140,10cyclictest800-21ssh23:25:121
1784299140,10cyclictest6829-21/usr/sbin/munin22:35:201
1784299140,10cyclictest4002-21ssh22:50:371
1784299140,10cyclictest31806-21sh21:20:461
1784299140,10cyclictest28189-21ssh23:04:491
1784299140,10cyclictest28176-21ssh23:21:521
1784299140,10cyclictest27898-21/usr/sbin/munin19:30:121
1784299140,10cyclictest26146-21sh21:18:151
1784299140,10cyclictest25153-21rm23:56:011
1784299140,10cyclictest24976-21ssh22:45:071
1784299140,10cyclictest23703-21rm21:50:421
1784299140,10cyclictest21561-21rm00:12:221
1784299140,10cyclictest20410-21cut19:15:001
1784299140,10cyclictest18596-21sh22:05:281
1784299140,10cyclictest17450-21rm21:47:461
1784299140,10cyclictest13284-21ssh21:28:501
1784299140,10cyclictest11808-21sh23:13:201
1784299140,10cyclictest11676-21rm21:10:181
1784299140,10cyclictest11456-21ssh22:01:511
1784299140,10cyclictest10580-21sh23:48:261
1784299140,10cyclictest10580-21sh23:48:261
1784299140,10cyclictest10107-21ssh00:05:341
1783799146,6cyclictest21057-21ssh21:50:020
1783799142,8cyclictest5921-21cpuspeed23:10:130
1783799141,9cyclictest30483-21sh23:05:200
1783799141,9cyclictest26123-21missed_timers19:25:180
1783799141,9cyclictest24528-21/usr/sbin/munin19:20:230
1783799141,9cyclictest14-21ksoftirqd/000:32:350
1783799141,7cyclictest18750-21latency_hist20:20:010
1783799140,9cyclictest14-21ksoftirqd/000:37:150
1783799140,10cyclictest831-21runrttasks22:10:040
1783799140,10cyclictest831-21runrttasks20:40:500
1783799140,10cyclictest831-21runrttasks19:59:440
1783799140,10cyclictest7899-21apt-get21:05:120
1783799140,10cyclictest7226-21sh22:00:050
1783799140,10cyclictest6430-21missed_timers21:00:180
1783799140,10cyclictest4716-21ssh00:20:400
1783799140,10cyclictest327-21systemd-journal19:16:590
1783799140,10cyclictest29353-21cat19:30:230
1783799140,10cyclictest28453-21latency_hist20:40:010
1783799140,10cyclictest25916-21aten2_r5power_p00:15:130
1783799140,10cyclictest25678-21runrttasks20:32:480
1783799140,10cyclictest24648-21sh23:55:390
1783799140,10cyclictest15822-21ssh22:40:070
1783799140,10cyclictest14932-21grep20:10:150
3184539130,11EcMasterDemoSyn2897-21chrt00:20:175
2617129130,4tAtEmLog_028205-21turbostat20:40:005
223472130,6sleep122358-21sh00:30:341
1872529130,3tAtEmLog_020282-21chrt20:20:215
1785499131,9cyclictest24924-21sh23:20:154
1785499131,9cyclictest18306-21/usr/sbin/munin20:15:264
1785499131,8cyclictest17736-21unixbench-2d22:40:244
1785499130,9cyclictest8990-21chrt19:56:164
1785499130,9cyclictest831-21runrttasks00:16:124
1785499130,9cyclictest6744-21sh22:35:094
1785499130,9cyclictest6197-21sh21:25:094
1785499130,9cyclictest5542-21/usr/sbin/munin21:00:254
1785499130,9cyclictest5276-21df_inode19:50:134
1785499130,9cyclictest3169-21/usr/sbin/munin20:55:214
1785499130,9cyclictest31256-21ssh22:30:194
1785499130,9cyclictest30142-21if_err_enp5s021:20:154
1785499130,9cyclictest27096-21taskset22:45:274
1785499130,9cyclictest25135-21ssh23:56:014
1785499130,9cyclictest24055-21sh21:50:564
1785499130,9cyclictest21873-21sh21:15:264
1785499130,9cyclictest21439-21/usr/sbin/munin20:25:124
1785499130,9cyclictest17478-21/usr/sbin/munin00:10:154
1785499130,9cyclictest16338-21ssh23:51:104
1785499130,9cyclictest14258-21cat20:10:014
1785499130,9cyclictest12016-21grep00:25:154
1785499130,9cyclictest11345-21sh22:01:474
1785499130,7cyclictest6043-21tr23:10:144
1785499130,10cyclictest30544-21cut19:35:154
1785499130,10cyclictest27964-21rm21:35:554
1785499130,10cyclictest26988-21grep20:35:184
1785499130,10cyclictest2293-21ssh00:20:064
1785499130,10cyclictest2037-21awk23:25:204
1785499130,10cyclictest14623-21ssh23:15:074
1785499130,10cyclictest12103-21tr22:55:204
1785499130,10cyclictest10293-21diskmemload21:10:024
1785099130,9cyclictest831-21runrttasks20:53:053
1785099130,9cyclictest831-21runrttasks19:42:533
1785099130,9cyclictest6217-21switchtime19:50:233
1785099130,9cyclictest3391-21if_enp5s022:15:163
1785099130,9cyclictest30876-21/usr/sbin/munin20:45:153
1785099130,9cyclictest18690-21expr19:10:133
1785099130,9cyclictest10528-21sh00:05:543
1785099130,10cyclictest831-21runrttasks20:06:333
1785099130,10cyclictest3989-21sed20:55:193
1785099130,10cyclictest28603-21basename19:30:163
1785099130,10cyclictest23849-21/usr/sbin/munin20:30:163
1785099130,10cyclictest21989-21grep19:15:253
1785099130,10cyclictest14343-21ssh21:45:393
1785099130,10cyclictest13352-21ssh00:25:283
1785099130,10cyclictest10365-21if_enp5s020:00:173
1785099130,10cyclictest10365-21if_enp5s020:00:173
1784599130,9cyclictest831-21runrttasks20:50:092
1784599130,9cyclictest8248-21ssh21:25:262
1784599130,9cyclictest7271-21/usr/sbin/munin19:55:202
1784599130,9cyclictest31904-21fschecks_count00:00:162
1784599130,9cyclictest30876-21/usr/sbin/munin20:45:132
1784599130,9cyclictest30067-21sh21:20:152
1784599130,9cyclictest2742-21ls19:45:132
1784599130,9cyclictest26219-21grep20:35:132
1784599130,9cyclictest2615-21aten2_r5power_v00:20:142
1784599130,9cyclictest24974-21latency_hist19:25:002
1784599130,9cyclictest23667-21latency_hist20:30:012
1784599130,9cyclictest20685-21sh22:25:022
1784599130,9cyclictest19026-21cat20:20:012
1784599130,9cyclictest15526-21sh21:30:082
1784599130,9cyclictest14694-21cstates20:10:132
1784599130,9cyclictest11741-21sh00:25:142
1784599130,8cyclictest892-21basename23:25:132
1784599130,10cyclictest9755-21ssh23:30:092
1784599130,10cyclictest6130-21grep21:00:152
1784599130,10cyclictest4770-21ssh22:51:092
1784599130,10cyclictest29008-21ssh00:35:112
1784599130,10cyclictest26570-21sh22:45:212
1784599130,10cyclictest26338-21missed_timers21:35:192
1784599130,10cyclictest24797-21cat20:30:192
1784299130,9cyclictest8515-21tr21:05:161
1784299130,9cyclictest4913-21runrttasks19:50:061
1784299130,9cyclictest3610-21sed22:15:181
1784299130,9cyclictest30253-21/usr/sbin/munin19:35:181
1784299130,9cyclictest30025-21ssh22:30:091
1784299130,9cyclictest29189-21hddtemp_smartct20:40:131
1784299130,9cyclictest28016-21aten2_r5power_p23:40:141
1784299130,9cyclictest25617-21runrttasks00:15:041
1784299130,9cyclictest2294-21sh21:40:051
1784299130,9cyclictest22903-21timerandwakeup20:25:231
1784299130,9cyclictest21738-21ssh21:33:131
1784299130,9cyclictest20740-21/usr/sbin/munin20:20:261
1784299130,9cyclictest20459-21/usr/sbin/munin19:15:251
1784299130,9cyclictest17465-21kernelversion20:15:191
1784299130,9cyclictest12228-21irqstats00:25:171
1784299130,9cyclictest11998-21/usr/sbin/munin20:05:181
1784299130,9cyclictest1020-21cpuspeed_turbos20:50:121
1784299130,10cyclictest3925-21awk19:45:251
1784299130,10cyclictest16-1pr/legacy20:35:101
1784299130,10cyclictest10875-21/usr/sbin/munin22:55:201
1783799131,9cyclictest5067-21runrttasks20:58:050
17837991310,2cyclictest19339-21cpuspeed_turbos20:20:140
1783799130,9cyclictest831-21runrttasks20:48:020
1783799130,9cyclictest831-21runrttasks19:50:560
1783799130,9cyclictest831-21runrttasks19:40:290
1783799130,9cyclictest831-21runrttasks19:10:090
1783799130,9cyclictest31923-21runrttasks19:35:410
1783799130,9cyclictest2043-21tr20:50:180
1783799130,9cyclictest12360-21/usr/sbin/munin20:05:150
1491739130,0EcMasterDemoSyn0-21swapper/523:32:395
75839120,0EcMasterDemoSyn0-21swapper/523:42:485
544499120,10tDemoTimingTask7788-21chrt21:42:415
3222099120,10tDemoTimingTask1989-21chrt19:42:025
2815529120,10tAtEmLog_028691-21chrt21:36:225
2451399120,10tDemoTimingTask29583-21chrt21:54:435
1957229123,7tAtEmLog_021059-21chrt23:18:285
1785499128,3cyclictest18526-21fschecks_count19:10:134
1785499120,9cyclictest831-21runrttasks19:20:064
1785499120,9cyclictest4229-21runrttasks19:45:314
1785499120,9cyclictest19795-21basename20:20:174
1785499120,8cyclictest23794-21grep20:30:064
1785099120,9cyclictest28517-21sshd20:40:063
1784599120,9cyclictest744-21snmpd19:15:032
1784599120,9cyclictest5984-21ntp_offset19:50:182
1784599120,7cyclictest17978-21sed19:10:002
1784299120,7cyclictest18050-21latency_hist19:10:001
1783799124,6cyclictest17866-21cut19:10:000
1531799120,10tDemoTimingTask17436-21chrt19:06:025
957239110,0EcMasterDemoSyn0-21swapper/521:05:365
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional