You are here: Home / Projects / OSADL QA Farm Real-time / Latency plots / 
2025-11-26 - 06:05
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.

Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes
Compare latency of primary with shadow system
Characteristics of the highest latencies:
System rackbslot4.osadl.org (updated Wed Nov 26, 2025 00:43:35)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
20598997918,26cyclictest20227-21ssh17:51:531
20598997918,26cyclictest20227-21ssh17:51:531
20598997119,45cyclictest29800-21ssh15:39:451
20598996919,43cyclictest15063-21/usr/sbin/munin14:08:301
20598996821,41cyclictest30574-21/usr/sbin/munin13:23:231
20598996820,42cyclictest11514-21ntp_kernel_err17:38:221
20598996818,43cyclictest23075-21/usr/sbin/munin13:03:381
20598996719,42cyclictest11320-21/usr/sbin/munin13:58:371
20598996717,44cyclictest14533-21uniq17:43:151
20598996621,39cyclictest7781-21grep16:43:321
20598996616,7cyclictest24750-21kworker/1:116:57:021
20598996522,10cyclictest9371-21iostat15:58:221
20598996521,39cyclictest2898-21ssh15:48:241
20598996520,38cyclictest24437-21/usr/sbin/munin14:33:291
20598996520,38cyclictest24437-21/usr/sbin/munin14:33:291
20598996519,40cyclictest560-21NetworkManager13:08:071
20598996518,41cyclictest16933-21/usr/sbin/munin14:13:211
20598996518,13cyclictest26313-21/usr/sbin/munin14:38:301
20598996518,13cyclictest26313-21/usr/sbin/munin14:38:301
20598996516,43cyclictest23269-21wget17:08:151
20598996422,35cyclictest13187-21/usr/sbin/munin14:03:391
20598996420,38cyclictest31514-21ssh17:19:221
20598996420,38cyclictest31514-21ssh17:19:221
20598996420,38cyclictest26829-21/usr/sbin/munin13:13:231
20598996420,37cyclictest19324-21timerwakeupswit15:23:401
20598996417,41cyclictest0-21swapper/116:58:271
20598996412,46cyclictest24750-21kworker/1:115:06:141
20598996321,9cyclictest27204-21missed_timers17:13:231
20598996321,36cyclictest32728-21latency16:33:201
20598996319,38cyclictest9770-21ssh15:09:041
20598996319,38cyclictest31945-21/usr/sbin/munin14:53:301
20598996319,38cyclictest21490-21aten_rbpower_po15:28:151
20598996319,38cyclictest1944-21perl18:13:151
20598996318,39cyclictest24888-21latency17:58:191
20598996318,39cyclictest21598-21ssh16:17:241
20598996317,40cyclictest24727-21/usr/sbin/munin15:33:351
20598996317,40cyclictest24727-21/usr/sbin/munin15:33:351
20598996315,42cyclictest667-21runrttasks16:32:371
20598996315,42cyclictest667-21runrttasks16:32:371
20598996312,44cyclictest20964-21/usr/sbin/munin17:53:291
20598996221,35cyclictest5384-21cut18:18:201
20598996220,9cyclictest26416-21sh16:23:301
20598996220,9cyclictest26416-21sh16:23:301
20598996219,37cyclictest19936-21wget17:03:161
20598996219,37cyclictest1397-21ssh15:46:361
20598996218,38cyclictest16438-21mailstats16:08:301
20598996218,38cyclictest10244-21perl16:48:181
20598996217,40cyclictest14159-21ssh16:05:141
20598996217,39cyclictest29484-21ssh18:04:541
20598996217,38cyclictest3502-21fschecks_time16:38:151
20598996214,42cyclictest15729-21ssh15:18:341
20598996121,34cyclictest7555-21/usr/sbin/munin13:48:331
20598996119,9cyclictest7148-21ssh15:54:101
20598996118,38cyclictest785-21aten_rbpower_en17:23:121
20598996118,38cyclictest785-21aten_rbpower_en17:23:121
20598996118,38cyclictest13190-21ssh15:14:191
20598996118,37cyclictest9600-21ssh18:24:581
20598996118,37cyclictest24632-21ssh16:21:401
20598996117,38cyclictest28703-21/usr/sbin/munin13:18:291
20598996116,39cyclictest0-21swapper/118:09:231
20598996111,44cyclictest5347-21ssh17:28:321
20598996020,34cyclictest28183-21/usr/sbin/munin14:43:161
20598996020,34cyclictest22564-21/usr/sbin/munin14:28:291
20598996020,34cyclictest22564-21/usr/sbin/munin14:28:291
20598996020,34cyclictest20691-21/usr/sbin/munin14:23:411
20598996019,35cyclictest10025-21latency13:53:241
20598996017,36cyclictest7279-21taskset13:47:331
20598996016,38cyclictest10023-21ssh17:36:521
20598996014,40cyclictest667-21runrttasks14:59:301
2061199594,48cyclictest0-21swapper/317:06:513
2061199594,47cyclictest0-21swapper/317:46:313
2061199594,47cyclictest0-21swapper/316:03:433
2060599595,48cyclictest0-21swapper/215:12:142
2060599595,48cyclictest0-21swapper/215:06:042
2060599575,7cyclictest0-21swapper/215:37:432
2060599575,7cyclictest0-21swapper/215:37:432
1870025712,15sleep30-21swapper/312:53:133
2061199565,7cyclictest0-21swapper/316:40:123
2060599554,46cyclictest0-21swapper/215:13:362
2060599554,45cyclictest0-21swapper/217:50:502
2060599554,45cyclictest0-21swapper/217:50:502
20598995517,33cyclictest22659-21sshd13:00:461
20605995441,9cyclictest29-21ksoftirqd/216:18:022
2061199535,41cyclictest0-21swapper/315:46:533
2061199532,44cyclictest19803-21ssh15:24:243
2060599535,42cyclictest0-21swapper/218:03:202
2061199524,42cyclictest0-21swapper/316:08:233
2061199523,44cyclictest0-21swapper/316:43:123
20611995213,7cyclictest23910-21sshd16:19:443
2060599525,40cyclictest0-21swapper/216:37:422
2060599523,44cyclictest0-21swapper/215:53:332
2060599523,43cyclictest0-21swapper/217:08:042
2060599522,44cyclictest4385-21unixbench_multi16:38:302
20605995213,34cyclictest5459-21latency_hist13:43:062
2061199511,43cyclictest37-21ksoftirqd/315:02:443
2061199505,39cyclictest0-21swapper/316:30:243
2061199505,39cyclictest0-21swapper/316:30:243
2061199505,38cyclictest0-21swapper/316:33:313
2061199504,40cyclictest0-21swapper/316:48:303
2061199504,38cyclictest0-21swapper/316:15:043
2061199503,41cyclictest0-21swapper/318:10:003
20611995012,32cyclictest0-21swapper/317:33:043
20611995011,34cyclictest1940-21kworker/3:117:40:103
20611995010,33cyclictest0-21swapper/315:36:273
20611995010,33cyclictest0-21swapper/315:36:273
2060599504,40cyclictest0-21swapper/215:52:232
2060599503,41cyclictest0-21swapper/215:25:442
20605995010,35cyclictest24734-21latency_hist13:08:072
2061199498,35cyclictest0-21swapper/318:02:163
2061199495,38cyclictest0-21swapper/313:33:173
2061199494,7cyclictest0-21swapper/316:54:423
2061199494,39cyclictest0-21swapper/318:06:413
2061199493,41cyclictest0-21swapper/317:21:113
2061199493,41cyclictest0-21swapper/317:21:113
2061199493,41cyclictest0-21swapper/316:58:123
2061199493,40cyclictest0-21swapper/315:03:343
2060599493,9cyclictest0-21swapper/217:35:512
2060599493,39cyclictest0-21swapper/216:09:132
2060599492,7cyclictest29864-21sort16:28:322
2060599492,7cyclictest29864-21sort16:28:322
2061199487,35cyclictest0-21swapper/318:19:163
2061199487,35cyclictest0-21swapper/315:53:213
2061199485,37cyclictest0-21swapper/317:49:593
2061199485,37cyclictest0-21swapper/317:49:593
2061199485,36cyclictest0-21swapper/317:13:183
2061199484,38cyclictest0-21swapper/317:09:183
2061199484,38cyclictest0-21swapper/315:18:233
2061199484,37cyclictest0-21swapper/317:54:463
2061199484,37cyclictest0-21swapper/315:10:263
2061199484,17cyclictest0-21swapper/316:24:563
2061199484,17cyclictest0-21swapper/316:24:563
2061199483,7cyclictest588-21irqbalance18:14:103
2061199483,40cyclictest0-21swapper/315:16:543
2061199483,11cyclictest0-21swapper/314:18:223
2060599488,34cyclictest0-21swapper/216:57:462
2060599484,38cyclictest0-21swapper/217:44:252
2060599484,38cyclictest0-21swapper/217:28:042
2060599484,38cyclictest0-21swapper/216:05:102
2060599484,38cyclictest0-21swapper/215:00:582
2060599484,38cyclictest0-21swapper/214:54:112
2060599484,38cyclictest0-21swapper/212:58:222
2060599484,37cyclictest0-21swapper/216:24:362
2060599484,37cyclictest0-21swapper/216:24:362
2060599483,41cyclictest0-21swapper/216:20:332
2060599483,40cyclictest0-21swapper/217:04:122
2060599483,40cyclictest0-21swapper/215:30:342
2060599483,40cyclictest0-21swapper/213:28:072
2060599483,39cyclictest0-21swapper/214:16:452
2060599483,11cyclictest15424-21fschecks_time14:08:202
2061199474,37cyclictest0-21swapper/317:29:303
2061199474,37cyclictest0-21swapper/317:27:483
2061199474,37cyclictest0-21swapper/317:27:483
2061199474,37cyclictest0-21swapper/315:48:373
2061199474,37cyclictest0-21swapper/313:38:263
2061199474,36cyclictest0-21swapper/313:43:213
2061199473,39cyclictest0-21swapper/315:29:043
2060599475,36cyclictest0-21swapper/218:26:132
2060599474,38cyclictest0-21swapper/213:12:162
2060599474,37cyclictest0-21swapper/217:19:012
2060599474,37cyclictest0-21swapper/217:19:012
2060599474,37cyclictest0-21swapper/217:14:232
2060599474,37cyclictest0-21swapper/217:00:032
2060599474,37cyclictest0-21swapper/215:20:432
2060599474,37cyclictest0-21swapper/214:03:372
2060599473,39cyclictest0-21swapper/218:19:002
2060599473,39cyclictest0-21swapper/214:38:192
2060599473,39cyclictest0-21swapper/214:38:192
2060599471,4cyclictest26027-21ssh17:59:302
20598994711,8cyclictest20294-21ps14:21:061
2061199469,5cyclictest0-21swapper/315:40:013
2061199463,38cyclictest0-21swapper/314:48:363
2061199463,38cyclictest0-21swapper/313:28:373
2061199463,35cyclictest0-21swapper/318:23:283
2061199461,39cyclictest32226-21sa113:28:063
2060599469,5cyclictest0-21swapper/216:47:452
2060599467,7cyclictest0-21swapper/216:50:482
2060599466,34cyclictest12679-21sshd13:59:462
2060599466,34cyclictest0-21swapper/217:24:512
2060599466,34cyclictest0-21swapper/217:24:512
2060599465,35cyclictest0-21swapper/218:09:332
2060599465,35cyclictest0-21swapper/217:41:372
2060599464,37cyclictest0-21swapper/214:47:152
2060599464,36cyclictest0-21swapper/216:02:542
2060599464,36cyclictest0-21swapper/214:23:442
2060599464,36cyclictest0-21swapper/214:20:242
2060599464,16cyclictest0-21swapper/215:47:482
2060599463,38cyclictest0-21swapper/214:33:192
2060599463,38cyclictest0-21swapper/214:33:192
2060599463,10cyclictest0-21swapper/214:28:182
2060599463,10cyclictest0-21swapper/214:28:182
20605994610,30cyclictest0-21swapper/218:15:122
20598994613,28cyclictest0-21swapper/114:51:341
2004924610,31sleep00-21swapper/012:54:310
188222463,10sleep218876-21df_inode12:53:202
2061199454,6cyclictest0-21swapper/314:48:053
2061199454,35cyclictest0-21swapper/315:58:073
2060599455,7cyclictest0-21swapper/217:57:262
2060599454,35cyclictest0-21swapper/213:58:062
2060599454,10cyclictest0-21swapper/213:37:512
20605994536,5cyclictest29-21ksoftirqd/213:33:062
2060599453,37cyclictest0-21swapper/215:38:272
2059499454,35cyclictest0-21swapper/017:22:060
2059499454,35cyclictest0-21swapper/017:22:060
2060599443,9cyclictest0-21swapper/213:15:522
2060599443,36cyclictest0-21swapper/213:43:452
2060599443,36cyclictest0-21swapper/213:21:512
2060599443,35cyclictest0-21swapper/214:49:402
20598994323,14cyclictest1935-21aten_rbpower_cu13:33:171
139452433,6sleep00-21swapper/015:16:190
2061199423,34cyclictest0-21swapper/314:17:553
20598994222,15cyclictest1046-21runrttasks13:28:331
312242413,6sleep00-21swapper/016:31:290
312242413,6sleep00-21swapper/016:31:290
2060599413,33cyclictest0-21swapper/213:49:432
176422413,6sleep00-21swapper/015:22:300
304282403,6sleep00-21swapper/013:23:070
257162403,6sleep00-21swapper/013:08:310
240932403,6sleep00-21swapper/014:31:400
240932403,6sleep00-21swapper/014:31:400
20598994025,9cyclictest3981-21diskstats13:38:201
20594994031,5cyclictest3-21ksoftirqd/015:58:030
2059499403,32cyclictest0-21swapper/018:08:280
197642404,8sleep10-21swapper/112:53:351
127452403,7sleep30-21swapper/314:00:283
239102393,6sleep00-21swapper/015:31:360
163322393,6sleep00-21swapper/014:08:380
107822393,7sleep30-21swapper/313:54:293
10512393,7sleep30-21swapper/314:56:093
2059499384,28cyclictest0-21swapper/018:23:490
15722383,6sleep00-21swapper/013:31:280
71282373,6sleep00-21swapper/013:45:450
39802372,31sleep03986-21sh18:16:460
20594993728,5cyclictest3-21ksoftirqd/016:18:020
20594993717,15cyclictest1125-21vmstat16:33:340
250762363,6sleep00-21swapper/016:22:510
2059499364,28cyclictest0-21swapper/016:52:310
91712353,6sleep00-21swapper/013:52:330
63562353,6sleep00-21swapper/017:30:580
277642353,6sleep00-21swapper/014:40:450
277642353,6sleep00-21swapper/014:40:450
2059499354,27cyclictest0-21swapper/017:07:250
2059499354,26cyclictest0-21swapper/018:21:280
72812343,6sleep00-21swapper/015:06:120
20611993421,8cyclictest25633-21grep14:33:353
20611993421,8cyclictest25633-21grep14:33:353
20611993414,7cyclictest93202wc13:53:063
2059499344,27cyclictest0-21swapper/016:45:170
2059499344,27cyclictest0-21swapper/016:05:040
2059499344,26cyclictest0-21swapper/016:11:170
2059499344,25cyclictest0-21swapper/016:24:380
2059499344,25cyclictest0-21swapper/016:24:380
2059499344,25cyclictest0-21swapper/015:40:430
2059499343,27cyclictest0-21swapper/017:56:580
2059499343,27cyclictest0-21swapper/015:34:380
2059499343,27cyclictest0-21swapper/015:34:380
2059499343,25cyclictest19298-21/usr/sbin/munin14:18:220
302972333,7sleep30-21swapper/313:22:303
2061199333,26cyclictest0-21swapper/313:01:423
2059499334,25cyclictest0-21swapper/017:34:350
2059499334,24cyclictest0-21swapper/015:25:580
2059499333,26cyclictest0-21swapper/015:58:350
2059499333,25cyclictest0-21swapper/015:08:170
2059499333,25cyclictest0-21swapper/013:41:250
20594993321,7cyclictest21517-21tune2fs12:58:220
20594993320,8cyclictest17595-21wc16:58:310
2061199323,24cyclictest0-21swapper/313:03:073
2059499324,24cyclictest0-21swapper/017:40:350
2059499324,23cyclictest0-21swapper/015:49:230
2059499324,23cyclictest0-21swapper/014:33:290
2059499324,23cyclictest0-21swapper/014:33:290
2059499323,25cyclictest0-21swapper/016:53:050
2059499323,25cyclictest0-21swapper/015:43:270
2059499323,24cyclictest0-21swapper/016:38:030
2059499323,24cyclictest0-21swapper/013:21:200
20594993220,7cyclictest23701-21sh17:08:210
20594993213,14cyclictest0-21swapper/017:58:250
11512323,6sleep00-21swapper/014:57:230
20611993119,7cyclictest13287-21cut14:03:183
2059499314,23cyclictest0-21swapper/018:03:500
2059499314,23cyclictest0-21swapper/017:44:350
2059499314,23cyclictest0-21swapper/017:24:280
2059499314,23cyclictest0-21swapper/017:24:280
2059499314,23cyclictest0-21swapper/013:58:510
2059499314,22cyclictest0-21swapper/014:03:260
2059499313,24cyclictest0-21swapper/014:51:040
2059499313,22cyclictest2744-21sed14:58:350
20594993122,5cyclictest18583-21sh14:18:050
2059499312,23cyclictest27762-21switchtime13:13:350
20594993118,8cyclictest27965-21sshd17:13:430
20611993021,5cyclictest37-21ksoftirqd/314:12:053
2059499304,22cyclictest0-21swapper/013:36:150
2059499304,21cyclictest0-21swapper/017:48:050
2059499304,21cyclictest0-21swapper/017:48:050
2059499303,23cyclictest0-21swapper/014:23:260
2059499303,22cyclictest0-21swapper/013:03:230
2061199294,19cyclictest0-21swapper/314:38:223
2061199294,19cyclictest0-21swapper/314:38:223
2061199294,19cyclictest0-21swapper/313:13:303
20611992916,8cyclictest22100-21sshd14:25:143
2059499294,20cyclictest0-21swapper/013:53:210
20594992914,11cyclictest28240-21aten_rbpower_po14:43:160
20611992817,6cyclictest22859-21fschecks_time14:28:193
20611992817,6cyclictest22859-21fschecks_time14:28:193
20611992816,7cyclictest25865-21swap13:08:333
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional