You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-09-05 - 00:03
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.

Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the highest latencies:
System rackbslot6.osadl.org (updated Fri Sep 04, 2026 12:43:32)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
812421820,5sleep32758499cyclictest13:35:523
1093821450,4sleep02756599cyclictest12:32:250
1068911030,34ptp4l401ktimersoftd/309:35:183
224752690,2sleep20-21swapper/214:56:162
213572690,4sleep341-21ksoftirqd/311:37:233
313892660,2sleep10-21swapper/112:20:381
27584996614,22cyclictest27434-21sh15:01:223
272642655,10sleep00-21swapper/009:34:310
190262650,1sleep30-21swapper/313:12:393
184902650,2sleep20-21swapper/211:32:212
143992640,2sleep00-21swapper/014:14:110
326252600,2sleep30-21swapper/312:54:003
197842600,2sleep20-21swapper/214:19:592
10052600,1sleep30-21swapper/314:01:493
271882544,38sleep10-21swapper/109:33:311
5092530,2sleep20-21swapper/212:54:352
281862520,2sleep10-21swapper/109:37:221
210042520,3sleep0111rcuc/011:37:200
2742124321,11sleep233-21ksoftirqd/209:36:312
27584994212,27cyclictest24011-21basename13:52:223
27565994123,12cyclictest46950irq/100-ens3-Tx14:02:230
106891410,1ptp4l401ktimersoftd/310:02:163
106891400,1ptp4l401ktimersoftd/312:40:103
106891380,1ptp4l401ktimersoftd/314:38:293
106891380,1ptp4l401ktimersoftd/312:42:573
106891380,1ptp4l401ktimersoftd/312:07:173
106891380,1ptp4l401ktimersoftd/311:44:293
2757899374,8cyclictest24044-21ssh13:52:222
2757899371,4cyclictest14365-21/usr/sbin/munin12:02:292
27578993713,4cyclictest2461-21grep09:47:342
27578993712,5cyclictest6391-21expr12:27:282
106891370,1ptp4l401ktimersoftd/315:06:193
106891370,1ptp4l401ktimersoftd/314:45:143
106891370,1ptp4l401ktimersoftd/314:34:403
106891370,1ptp4l401ktimersoftd/314:19:233
106891370,1ptp4l401ktimersoftd/313:42:513
106891370,1ptp4l401ktimersoftd/313:42:513
106891370,1ptp4l401ktimersoftd/313:08:423
106891370,1ptp4l401ktimersoftd/312:50:293
106891370,1ptp4l401ktimersoftd/312:27:333
106891370,1ptp4l401ktimersoftd/311:51:023
106891370,0ptp4l401ktimersoftd/314:51:213
106891370,0ptp4l401ktimersoftd/312:58:083
2757899363,8cyclictest4403-21apt-get13:32:212
2757899363,5cyclictest0-21swapper/213:47:242
2757899363,5cyclictest0-21swapper/213:47:242
2757899362,31cyclictest32379-21grep13:27:262
27578993614,19cyclictest28842-21sh11:44:362
106891360,1ptp4l401ktimersoftd/314:10:333
106891360,1ptp4l401ktimersoftd/313:19:163
106891360,1ptp4l401ktimersoftd/312:17:443
106891360,1ptp4l401ktimersoftd/312:12:123
106891360,1ptp4l401ktimersoftd/311:57:163
106891360,1ptp4l401ktimersoftd/311:57:163
106891360,1ptp4l401ktimersoftd/309:37:243
106891360,0ptp4l401ktimersoftd/314:02:343
106891360,0ptp4l401ktimersoftd/313:25:463
106891360,0ptp4l401ktimersoftd/312:24:303
2758499359,22cyclictest30016-21irqrtprio10:47:243
27584993511,21cyclictest11824-21switchtime12:32:353
2757899359,4cyclictest9080-21grep11:12:202
27578993515,17cyclictest47150irq/102-ens3-Tx14:12:402
27578993513,3cyclictest15891-21sh13:10:382
27578993512,3cyclictest30917-21cron14:32:122
106891350,1ptp4l401ktimersoftd/314:52:553
106891350,1ptp4l401ktimersoftd/314:12:133
106891350,0ptp4l401ktimersoftd/314:30:173
106891350,0ptp4l401ktimersoftd/310:59:113
2758499348,3cyclictest16179-21cut11:27:203
2758499344,26cyclictest0-21swapper/310:22:213
27584993412,18cyclictest10844-21sh13:37:423
27584993410,21cyclictest12994-21acpi12:02:183
27584993410,20cyclictest31034-21expr09:42:193
2757899349,3cyclictest1753-21basename10:57:182
2757899342,7cyclictest2447-21apt-get12:57:202
27578993414,3cyclictest32486-21sh15:06:372
27578993413,4cyclictest29884-21sh13:24:252
27578993413,4cyclictest20484-21diskmemload14:03:272
27578993412,3cyclictest30192-21ls13:57:342
27578993412,3cyclictest11976-21sed13:07:112
27578993411,4cyclictest23039-21cstates12:12:212
2757899341,12cyclictest20374-21if_ens310:27:242
2757899341,11cyclictest31331-21rm14:32:242
106891340,1ptp4l401ktimersoftd/313:50:413
106891340,1ptp4l401ktimersoftd/313:50:413
27584993312,18cyclictest7901-21hddtemp_smartct13:02:273
27584993311,19cyclictest10535-21expr10:07:203
2757899339,3cyclictest25737-21if_err_enp1s0.112:47:282
2757899339,3cyclictest17477-21df13:12:242
2757899332,8cyclictest26896-21apt-get10:42:172
27578993313,3cyclictest13028-21sh13:40:502
27578993312,4cyclictest23882-21sh11:39:322
27578993311,3cyclictest2766-21sh11:52:002
27578993311,3cyclictest23444-21sh12:45:082
27578993310,4cyclictest26311-21sh13:21:432
27578993310,4cyclictest1888-21cat12:22:372
276692320,5sleep125-21ksoftirqd/113:55:411
2758499329,3cyclictest20690-21kernelversion10:27:253
2758499328,3cyclictest7822-21latency_hist11:57:083
2758499327,3cyclictest26041-21ls10:37:353
2758499326,24cyclictest6394-21kworker/3:014:25:483
27584993212,17cyclictest10998-21idleruntime-cro11:17:083
27584993210,19cyclictest1178-21cat13:27:383
27584993210,18cyclictest11531-21expr11:17:223
2757899328,3cyclictest31438-21cat10:52:072
2757899325,7cyclictest0-21swapper/215:02:142
2757899321,5cyclictest6519-21sed09:57:242
2757899321,5cyclictest19403-21snmp_o5powerctl12:07:322
27578993211,3cyclictest9991-21latency_hist10:07:062
27578993211,3cyclictest21817-21cut14:22:282
2757899321,11cyclictest11548-21ssh12:32:292
2757899321,10cyclictest4083-21ssh14:37:262
2757899321,10cyclictest179172sleep213:45:502
2757899321,10cyclictest179172sleep213:45:502
2757299321,22cyclictest14202-21ssh13:42:201
2757299321,22cyclictest14202-21ssh13:42:201
27584993111,16cyclictest7631-21latency_hist10:02:063
2757899319,4cyclictest31936-21open_files09:42:262
2757899319,3cyclictest9676-21sh14:09:302
2757899319,3cyclictest16861-21sh14:50:032
2757899318,4cyclictest8879-21cstates14:42:252
2757899313,9cyclictest16056-21apt-get11:27:182
2757899313,7cyclictest10316-21apt-get10:07:182
27578993111,3cyclictest1523-21latency_hist10:57:082
27578993110,4cyclictest17871-21seq12:38:592
27578993110,3cyclictest25240-21irqrtprio10:37:252
27565993125,3cyclictest9-21ksoftirqd/013:47:110
27565993125,3cyclictest9-21ksoftirqd/013:47:110
2758499307,2cyclictest0-21swapper/311:27:073
2758499306,3cyclictest4445-21df11:02:233
2758499306,3cyclictest20265-21seq11:34:273
27584993012,15cyclictest41-21ksoftirqd/309:48:443
27584993010,17cyclictest31800-21/usr/sbin/munin10:52:203
27578993023,4cyclictest33-21ksoftirqd/212:18:502
223082300,2sleep3391rcuc/310:32:203
2758499294,4cyclictest15487-21head10:17:223
27584992910,16cyclictest41-21ksoftirqd/310:44:063
2757899297,4cyclictest12919-21unixbench_multi11:17:372
27578992912,3cyclictest15528-21hddtemp_smartct10:17:222
27565992923,3cyclictest9-21ksoftirqd/010:47:070
106891290,1ptp4l401ktimersoftd/311:07:183
2758499288,3cyclictest4581-21cat09:52:333
2758499281,6cyclictest13082-21grep10:12:213
2758499281,6cyclictest13082-21grep10:12:213
27578992821,4cyclictest33-21ksoftirqd/209:37:192
2757899280,11cyclictest7930-21cat11:57:092
27565992822,3cyclictest9-21ksoftirqd/012:37:360
27565992822,3cyclictest9-21ksoftirqd/011:47:210
2757899272,7cyclictest12682-21apt-get10:12:182
2757899272,7cyclictest12682-21apt-get10:12:182
2757299273,3cyclictest121rcu_preempt12:46:381
27572992720,4cyclictest25-21ksoftirqd/114:59:361
27572992717,7cyclictest25-21ksoftirqd/115:05:431
27565992722,3cyclictest9-21ksoftirqd/013:07:260
27565992721,3cyclictest9-21ksoftirqd/011:27:220
27565992720,4cyclictest20484-21diskmemload14:42:410
306382260,22sleep030641-21snmp_o5powerctl10:47:310
27578992619,4cyclictest33-21ksoftirqd/211:10:372
27565992621,3cyclictest9-21ksoftirqd/012:07:370
27565992615,7cyclictest0-21swapper/015:02:220
27572992519,3cyclictest25-21ksoftirqd/110:15:391
27572992519,3cyclictest25-21ksoftirqd/110:15:391
27572992518,4cyclictest25-21ksoftirqd/114:38:091
27572992518,4cyclictest25-21ksoftirqd/110:23:021
27572992518,4cyclictest25-21ksoftirqd/110:20:171
27572992518,3cyclictest25-21ksoftirqd/112:38:571
27572992518,3cyclictest25-21ksoftirqd/110:02:051
27565992519,3cyclictest9-21ksoftirqd/012:15:150
27565992519,3cyclictest9-21ksoftirqd/011:21:500
27565992518,4cyclictest9-21ksoftirqd/011:09:380
27565992518,4cyclictest9-21ksoftirqd/010:26:180
27565992516,5cyclictest9-21ksoftirqd/009:52:180
37702241,3sleep14012-21irqrtprio09:52:241
27572992418,3cyclictest25-21ksoftirqd/110:39:031
27572992418,3cyclictest25-21ksoftirqd/110:11:171
27572992417,4cyclictest601-21sed14:32:401
27572992417,4cyclictest25-21ksoftirqd/114:27:571
27572992417,4cyclictest25-21ksoftirqd/114:17:411
27572992417,4cyclictest25-21ksoftirqd/114:00:511
27572992417,4cyclictest25-21ksoftirqd/112:30:171
27572992417,4cyclictest25-21ksoftirqd/111:12:401
2756599247,14cyclictest31156-21open_inodes12:52:300
27565992420,2cyclictest9-21ksoftirqd/014:27:120
27565992418,3cyclictest9-21ksoftirqd/013:01:280
27565992418,3cyclictest9-21ksoftirqd/010:37:470
27565992418,3cyclictest9-21ksoftirqd/010:33:250
27565992418,3cyclictest9-21ksoftirqd/009:41:570
27565992417,4cyclictest9-21ksoftirqd/009:48:370
27565992417,4cyclictest20291-21tr12:42:240
27565992416,5cyclictest16640-21grep10:17:340
27565992416,4cyclictest1371-21needreboot12:22:290
280142230,2sleep10-21swapper/111:43:121
27578992316,4cyclictest33-21ksoftirqd/211:24:302
27578992316,4cyclictest33-21ksoftirqd/211:02:102
27572992318,3cyclictest25-21ksoftirqd/114:10:031
27572992316,4cyclictest25-21ksoftirqd/111:32:111
27572992316,4cyclictest25-21ksoftirqd/111:27:461
27572992316,4cyclictest25-21ksoftirqd/110:06:321
27572992316,4cyclictest11994-21wc13:07:111
2757299231,19cyclictest0-21swapper/114:57:131
2756599232,17cyclictest30967-21grep13:57:440
27565992318,3cyclictest9-21ksoftirqd/013:12:300
27565992318,3cyclictest9-21ksoftirqd/012:47:210
27565992318,3cyclictest25804-1kworker/u9:213:32:260
27565992318,3cyclictest1224-1kworker/u9:014:38:300
27565992317,3cyclictest9-21ksoftirqd/011:25:280
27565992317,3cyclictest9-21ksoftirqd/011:03:280
27565992316,4cyclictest9-21ksoftirqd/010:08:400
27565992316,4cyclictest9-21ksoftirqd/010:00:410
27565992315,5cyclictest1055-21runrttasks13:42:110
2757299225,15cyclictest18283-21kworker/u8:114:48:291
27572992216,3cyclictest25-21ksoftirqd/110:49:521
27572992216,3cyclictest2453-21grep09:47:341
27572992215,4cyclictest2069-21latency_hist12:57:111
2757299221,4cyclictest3921-21snmp_o5powerctl12:57:351
2757299221,4cyclictest27582-21latency_hist12:17:091
27572992214,5cyclictest11129-21grep13:37:451
2757299221,18cyclictest0-21swapper/112:47:301
27572992210,3cyclictest30978-21sh13:26:171
27565992217,3cyclictest9-21ksoftirqd/012:04:310
27565992216,3cyclictest9-21ksoftirqd/011:33:190
27565992216,3cyclictest9-21ksoftirqd/009:43:220
27565992216,3cyclictest27590-21grep11:42:350
27565992215,4cyclictest9-21ksoftirqd/014:10:580
210582221,17sleep121068-21ssh12:09:461
2757299212,16cyclictest23961-21ssh13:17:431
27572992115,4cyclictest3860-21if_enp1s0.111:52:251
27572992114,4cyclictest8871-21cut11:57:251
27572992114,4cyclictest8871-21cut11:57:251
27572992114,4cyclictest31759-21cat11:47:271
27572992114,4cyclictest25-21ksoftirqd/110:34:181
27572992114,4cyclictest2355-21cat10:57:241
27572992114,4cyclictest1469-21ssh14:02:131
27572992114,4cyclictest1299-21grep13:27:391
27572992114,4cyclictest11228-21/usr/sbin/munin11:17:331
27572992114,4cyclictest1055-21runrttasks13:47:411
27572992114,4cyclictest1055-21runrttasks13:47:411
27572992113,4cyclictest1055-21runrttasks12:32:351
27572992110,8cyclictest20271-21gltestperf10:27:231
27565992116,3cyclictest9-21ksoftirqd/014:57:310
27565992115,3cyclictest9-21ksoftirqd/014:47:320
27565992115,3cyclictest11320-21sh13:06:150
27565992114,4cyclictest3397-21sh14:37:120
27565992114,4cyclictest1055-21runrttasks11:53:340
2757899208,9cyclictest8864-21grep11:57:252
2757899208,9cyclictest8864-21grep11:57:252
27578992015,3cyclictest33-21ksoftirqd/209:56:262
27572992016,2cyclictest0-21swapper/110:46:351
27572992014,3cyclictest25-21ksoftirqd/111:26:461
27572992014,3cyclictest25-21ksoftirqd/111:06:561
27572992014,3cyclictest21814-21fschecks_count14:22:281
27572992014,3cyclictest13440-21awk13:07:311
27572992014,3cyclictest11899-21cat14:12:241
27572992014,3cyclictest10114-21mailstats14:42:351
27572992013,4cyclictest7891-21tr11:07:301
27572992013,4cyclictest4750-21cut13:32:251
27572992013,4cyclictest47050irq/101-ens3-Tx11:37:371
27572992013,4cyclictest25-21ksoftirqd/113:14:501
27572992013,4cyclictest25-21ksoftirqd/110:52:211
27572992012,5cyclictest30677-21df09:42:101
2756599204,9cyclictest27814-21apt-get12:17:220
27565992015,3cyclictest9-21ksoftirqd/014:52:300
27565992015,3cyclictest9-21ksoftirqd/010:57:230
27565992014,5cyclictest0-21swapper/013:55:340
27565992014,3cyclictest9-21ksoftirqd/010:54:490
27565992014,3cyclictest9-21ksoftirqd/010:27:360
27565992013,4cyclictest9927-21idleruntime-cro12:32:090
27565992013,4cyclictest30848-21sh13:26:040
27565992013,4cyclictest26593-21idleruntime-cro13:22:100
27565992013,4cyclictest1055-21runrttasks13:27:230
27565992012,4cyclictest14264-21unixbench-2d10:12:340
27565992012,4cyclictest14264-21unixbench-2d10:12:340
27578991913,3cyclictest18875-21timerandwakeup10:22:322
27578991912,4cyclictest23504-21snmp_o5powerctl10:32:312
27572991912,4cyclictest395-21cat12:22:221
27572991911,5cyclictest13319-21df_inode12:02:211
27565991912,4cyclictest9769-21sed11:12:260
27565991912,4cyclictest8319-21cpuspeed_turbos11:57:200
27565991912,4cyclictest8319-21cpuspeed_turbos11:57:200
27565991912,4cyclictest27566-21needreboot14:27:340
27565991912,4cyclictest20498-21sendmail_mailqu13:47:350
27565991912,4cyclictest20498-21sendmail_mailqu13:47:350
27565991912,4cyclictest17260-21cat14:17:330
27565991911,4cyclictest1055-21runrttasks10:02:180
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional