You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-05-28 - 01:23

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #b, slot #5

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  Phytec
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.

Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the 792 highest latencies:
System rackbslot5s.osadl.org (updated Wed May 27, 2026 12:44:48)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
3219639995346,4cyclictest3273546-21kworker/u8:2+events_unbound10:44:422
3219634995042,5cyclictest3323379-21kworker/u8:0+events_unbound12:09:561
321963199501,46cyclictest0-21swapper/010:15:100
3219634994840,5cyclictest208-21systemd-logind11:34:481
3219639994638,4cyclictest0-21swapper/207:15:022
3219643994411,7cyclictest0-21swapper/310:40:003
3219639994433,7cyclictest3313297-21munin-plugin-st11:40:012
3219634994436,5cyclictest645-21runrttasks11:49:521
3219643994334,5cyclictest0-21swapper/307:15:023
3219634994332,8cyclictest3304155-21grep11:10:241
3219643994117,3cyclictest0-21swapper/312:35:253
3219643994013,3cyclictest0-21swapper/308:00:013
3219639994030,7cyclictest3251487-21munin-plugin-st08:40:002
3219639994026,11cyclictest311ktimers/211:55:102
3219639994024,5cyclictest3230430-21kworker/u8:3+events_unbound09:16:292
3219631994031,5cyclictest3221399-21latency_hist07:15:010
3219631994026,10cyclictest121ktimers/009:20:110
3219631993931,4cyclictest3276641-21unixbench_singl09:50:250
3219643993830,4cyclictest3258311-21munin-plugin-st09:00:013
3219639993830,5cyclictest3300676-21grep11:00:242
3219643993712,4cyclictest0-21swapper/312:25:153
3219643993712,4cyclictest0-21swapper/312:25:153
3219639993725,7cyclictest3290516-21unixbench_singl10:30:242
3219639993720,5cyclictest3295813-21kworker/u8:1+events_unbound12:09:182
3219634993730,4cyclictest3258302-21sendmail09:00:011
3219634993727,8cyclictest231ktimers/109:50:121
3219634993726,7cyclictest0-21swapper/112:15:241
3219634993724,9cyclictest231ktimers/108:20:121
3219634993724,9cyclictest231ktimers/108:20:121
3219643993628,4cyclictest0-21swapper/310:20:013
3219639993628,4cyclictest0-21swapper/212:15:002
3219639993628,4cyclictest0-21swapper/208:20:002
3219639993628,4cyclictest0-21swapper/208:20:002
3219634993626,6cyclictest0-21swapper/110:05:151
3219634993624,8cyclictest3233807-21grep07:45:251
3219643993513,3cyclictest0-21swapper/312:00:233
3219639993528,4cyclictest3237638-21sendmail08:00:012
3219639993527,4cyclictest0-21swapper/207:35:162
3219639993526,6cyclictest0-21swapper/209:05:242
3219634993528,4cyclictest3230812-21latency_hist07:40:001
3219634993527,4cyclictest0-21swapper/110:40:001
3219634993527,4cyclictest0-21swapper/110:10:231
3219634993525,6cyclictest0-21swapper/107:55:221
3219631993527,4cyclictest0-21swapper/007:15:030
3219631993526,6cyclictest3258303-21munin-plugin-st09:00:010
3219631993526,6cyclictest121ktimers/010:10:110
3219631993526,4cyclictest0-21swapper/011:30:240
3219643993427,3cyclictest3277065-21cron09:55:003
3219643993423,7cyclictest3323062-21grep12:05:253
3219639993425,6cyclictest3225286-21grep07:20:242
3219639993423,7cyclictest0-21swapper/209:40:242
3219634993426,5cyclictest3221679-21uniq07:15:021
3219631993426,4cyclictest3316706-21auditctl11:50:000
3219631993424,7cyclictest3331613-21grep12:30:250
3219643993325,4cyclictest0-21swapper/310:45:243
3219643993323,6cyclictest3300684-21grep11:00:243
3219643993321,8cyclictest0-21swapper/312:00:003
3219639993327,4cyclictest3273546-21kworker/u8:2+events_unbound10:09:122
3219634993325,4cyclictest0-21swapper/110:25:181
3219634993323,6cyclictest0-21swapper/109:10:251
3219631993325,4cyclictest0-21swapper/009:50:000
3219643993224,4cyclictest0-21swapper/310:10:233
3219643993223,4cyclictest0-21swapper/310:20:163
3219639993226,4cyclictest3230430-21kworker/u8:3+events_unbound09:57:382
3219639993224,4cyclictest0-21swapper/212:15:142
3219639993224,4cyclictest0-21swapper/207:45:152
3219639993222,7cyclictest311ktimers/209:25:132
3219639993221,6cyclictest0-21swapper/208:25:002
3219639993221,6cyclictest0-21swapper/208:25:002
3219634993226,4cyclictest3292869-21kworker/u8:0+events_unbound11:43:591
3219634993224,4cyclictest0-21swapper/111:35:151
3219634993223,6cyclictest3271538-21grep09:35:241
3219634993222,7cyclictest3328167-21grep12:20:251
3219634993222,6cyclictest0-21swapper/112:30:001
3219634993222,6cyclictest0-21swapper/112:30:001
3219634993222,6cyclictest0-21swapper/109:45:241
3219634993220,8cyclictest3333765-21sendmail12:40:001
3219631993224,4cyclictest0-21swapper/012:15:240
3219631993222,7cyclictest3330350-21auditctl12:30:000
3219631993222,7cyclictest3330350-21auditctl12:30:000
3219631993222,7cyclictest121ktimers/007:40:110
3219631993221,7cyclictest3289208-21cron10:30:000
3219643993123,4cyclictest0-21swapper/309:15:143
3219643993119,8cyclictest0-21swapper/309:40:153
3219639993125,4cyclictest3323379-21kworker/u8:0+events_unbound12:29:592
3219639993125,4cyclictest3323379-21kworker/u8:0+events_unbound12:29:592
3219639993125,4cyclictest3230430-21kworker/u8:3+events_unbound08:10:422
3219639993124,3cyclictest0-21swapper/209:35:242
3219639993122,5cyclictest0-21swapper/209:50:002
3219639993121,6cyclictest3333331-21grep12:35:252
3219634993123,4cyclictest0-21swapper/107:20:151
3219634993121,6cyclictest0-21swapper/111:00:241
3219634993120,8cyclictest3280013-21grep10:00:241
3219634993120,7cyclictest3290514-21grep10:30:241
3219634993120,7cyclictest0-21swapper/108:25:261
3219634993120,7cyclictest0-21swapper/108:25:261
3219631993119,8cyclictest0-21swapper/009:30:000
3219631993118,3cyclictest131rcu_preempt10:05:110
3219643993023,3cyclictest0-21swapper/310:30:243
3219643993021,5cyclictest0-21swapper/308:40:003
3219643993019,7cyclictest3235470-21grep07:50:253
3219643993019,7cyclictest0-21swapper/311:45:003
3219639993024,4cyclictest2985597-21kworker/u8:2+events_unbound08:46:532
3219639993023,4cyclictest0-21swapper/209:10:262
3219639993022,4cyclictest3328661-21munin-plugin-st12:25:002
3219639993017,9cyclictest311ktimers/208:55:132
3219634993023,4cyclictest0-21swapper/112:00:001
3219634993023,4cyclictest0-21swapper/108:40:001
3219634993021,6cyclictest3298149-21tune2fs10:55:161
3219634993020,6cyclictest0-21swapper/109:40:231
3219634993020,6cyclictest0-21swapper/107:30:001
3219634993020,6cyclictest0-21swapper/107:30:001
3219634993018,9cyclictest231ktimers/108:15:131
3219634993018,9cyclictest231ktimers/108:15:131
3219631993022,4cyclictest0-21swapper/008:35:260
3219631993021,6cyclictest3242961-21sh08:15:000
3219631993019,7cyclictest3287100-21grep10:20:260
3219643992922,3cyclictest0-21swapper/309:04:163
3219643992921,4cyclictest3234226-21sh07:50:013
3219643992921,4cyclictest0-21swapper/307:40:253
3219639992923,4cyclictest3249664-21kworker/u8:0+events_unbound08:50:412
3219639992922,5cyclictest3249664-21kworker/u8:0+events_unbound10:29:402
3219639992921,5cyclictest311ktimers/211:50:122
3219639992921,4cyclictest0-21swapper/210:15:142
3219634992919,6cyclictest0-21swapper/111:30:011
3219631992922,5cyclictest3273546-21kworker/u8:2+events_unbound09:59:290
3219631992921,4cyclictest0-21swapper/008:00:010
3219643992817,7cyclictest3268535-21sh09:30:003
3219643992817,6cyclictest0-21swapper/307:20:243
3219639992822,4cyclictest2985597-21kworker/u8:2+events_unbound07:50:412
3219639992820,5cyclictest0-21swapper/210:40:002
3219639992818,7cyclictest3316707-21taskset11:50:002
3219634992820,5cyclictest0-21swapper/109:05:151
3219634992820,4cyclictest0-21swapper/108:34:131
3219634992819,6cyclictest0-21swapper/112:10:231
3219634992818,7cyclictest3221911-21timerwakeupswit07:15:021
3219634992817,7cyclictest0-21swapper/111:20:001
3219631992821,5cyclictest3223037-21kworker/u8:3+events_unbound07:29:010
3219631992821,5cyclictest3223037-21kworker/u8:3+events_unbound07:29:010
3219631992820,4cyclictest13550irq/42-30be0000.ethernet11:24:480
3219631992820,4cyclictest0-21swapper/012:00:240
3219631992815,8cyclictest3239520-21apt-key08:05:010
3219631992814,11cyclictest121ktimers/009:30:110
3219643992720,4cyclictest3304149-21sed11:10:243
3219643992718,5cyclictest3306272-21sendmail11:20:003
3219643992718,5cyclictest0-21swapper/308:05:013
3219643992717,6cyclictest3297747-21basename10:55:003
3219643992717,6cyclictest0-21swapper/307:15:313
3219639992721,3cyclictest0-21swapper/207:25:262
3219639992721,3cyclictest0-21swapper/207:25:262
3219639992719,5cyclictest0-21swapper/208:05:012
3219639992718,5cyclictest0-21swapper/208:25:172
3219639992718,5cyclictest0-21swapper/208:25:172
3219639992717,4cyclictest0-21swapper/208:40:252
321963999271,4cyclictest131rcu_preempt12:30:112
321963499278,4cyclictest3251932-21grep08:40:161
321963499277,6cyclictest131rcu_preempt10:50:111
3219634992720,5cyclictest3230430-21kworker/u8:3+events_unbound07:44:051
3219634992719,5cyclictest0-21swapper/110:15:201
3219631992720,4cyclictest0-21swapper/008:15:250
3219631992720,4cyclictest0-21swapper/008:15:250
3219631992719,4cyclictest0-21swapper/010:40:230
3219631992718,7cyclictest0-21swapper/007:40:000
321963199271,5cyclictest3279015-21apt-get10:00:120
3219643992619,4cyclictest3313290-21kthreadd11:40:013
3219643992617,5cyclictest0-21swapper/308:10:153
3219639992620,4cyclictest3249664-21kworker/u8:0+events_unbound10:14:332
3219639992619,5cyclictest3292869-21kworker/u8:0+events_unbound11:31:402
3219639992619,5cyclictest3266701-21kworker/u8:2+events_unbound09:24:362
3219639992619,4cyclictest0-21swapper/208:30:252
3219639992612,5cyclictest3273546-21kworker/u8:2+events_unbound11:17:412
3219634992617,5cyclictest0-21swapper/108:15:001
3219631992618,4cyclictest0-21swapper/010:55:160
3219631992618,4cyclictest0-21swapper/008:44:360
3219631992613,10cyclictest438-21cron11:10:000
3219631992613,10cyclictest438-21cron11:10:000
3219643992518,3cyclictest0-21swapper/309:45:243
3219643992518,3cyclictest0-21swapper/307:35:013
3219643992517,5cyclictest0-21swapper/308:20:003
3219643992517,5cyclictest0-21swapper/308:20:003
3219643992517,4cyclictest0-21swapper/309:35:233
3219639992518,4cyclictest0-21swapper/211:40:132
3219639992516,6cyclictest3224006-21ls07:20:012
3219639992514,8cyclictest3308185-21sh11:25:002
321963499259,4cyclictest131rcu_preempt12:30:121
3219634992518,5cyclictest3313534-21kworker/u8:2+events_unbound12:04:571
3219634992518,5cyclictest3295813-21kworker/u8:1+events_unbound11:09:471
3219634992518,5cyclictest3295813-21kworker/u8:1+events_unbound11:09:471
3219634992518,5cyclictest3230430-21kworker/u8:3+events_unbound09:23:281
3219634992518,5cyclictest3230430-21kworker/u8:3+events_unbound07:52:241
3219634992517,5cyclictest0-21swapper/109:25:171
3219634992516,5cyclictest0-21swapper/108:55:011
321963499251,5cyclictest0-21swapper/109:02:251
321963199255,16cyclictest3248081-21audit_send_reply08:30:000
321963199255,16cyclictest3248081-21audit_send_reply08:30:000
3219631992518,4cyclictest0-21swapper/011:25:260
3219631992514,7cyclictest3290513-21grep10:30:240
3219631992514,7cyclictest0-21swapper/009:15:240
3219643992418,3cyclictest0-21swapper/311:20:213
3219643992417,4cyclictest0-21swapper/310:55:253
321963999241,12cyclictest0-21swapper/211:11:002
3219634992417,5cyclictest3227632-21kworker/u8:0+events_unbound07:34:031
3219634992410,10cyclictest231ktimers/109:15:121
3219631992420,2cyclictest13550irq/42-30be0000.ethernet09:00:190
3219631992418,3cyclictest0-21swapper/007:45:150
3219631992417,3cyclictest0-21swapper/011:04:100
3219631992417,3cyclictest0-21swapper/008:23:170
3219631992417,3cyclictest0-21swapper/008:23:170
3219631992415,4cyclictest0-21swapper/011:15:230
3219631992414,6cyclictest3303249-21uniq11:10:150
321963199241,19cyclictest0-21swapper/012:13:290
321963199241,19cyclictest0-21swapper/011:58:490
321963199241,19cyclictest0-21swapper/011:35:390
321963199241,19cyclictest0-21swapper/007:21:380
3219643992317,3cyclictest0-21swapper/309:20:233
3219643992316,4cyclictest3302421-21grep11:05:233
3219643992316,4cyclictest3302421-21grep11:05:233
3219643992316,4cyclictest3288764-21grep10:25:253
3219643992316,3cyclictest0-21swapper/311:35:013
3219643992314,6cyclictest0-21swapper/307:40:003
3219639992317,4cyclictest3292869-21kworker/u8:0+events_unbound11:27:232
3219639992317,4cyclictest3227632-21kworker/u8:0+events_unbound07:32:212
3219639992316,5cyclictest3295813-21kworker/u8:1+events_unbound11:08:222
3219639992316,5cyclictest3295813-21kworker/u8:1+events_unbound11:08:222
3219639992316,3cyclictest0-21swapper/210:50:002
3219639992315,6cyclictest3273546-21kworker/u8:2+events_unbound10:00:422
3219639992312,7cyclictest0-21swapper/209:50:182
321963999231,18cyclictest3297975-21taskset10:55:132
3219634992317,3cyclictest0-21swapper/110:40:161
3219634992317,3cyclictest0-21swapper/108:45:201
3219634992317,3cyclictest0-21swapper/108:05:011
3219634992312,8cyclictest3294679-21df_inode10:45:131
3219634992311,4cyclictest3249664-21kworker/u8:0+events_unbound09:58:131
321963199233,18cyclictest0-21swapper/009:35:450
321963199231,6cyclictest3292609-21cron10:40:000
3219631992316,3cyclictest0-21swapper/012:21:430
3219631992316,3cyclictest0-21swapper/011:41:440
3219631992316,3cyclictest0-21swapper/007:51:090
3219631992314,5cyclictest0-21swapper/008:09:390
321963199231,20cyclictest0-21swapper/011:50:150
321963199231,20cyclictest0-21swapper/010:50:160
321963199231,18cyclictest0-21swapper/009:11:440
321963199230,19cyclictest0-21swapper/008:47:530
321963199230,19cyclictest0-21swapper/008:30:310
3219643992216,3cyclictest0-21swapper/310:40:143
3219643992216,3cyclictest0-21swapper/308:50:253
3219643992216,3cyclictest0-21swapper/307:25:263
3219643992216,3cyclictest0-21swapper/307:25:263
3219643992215,4cyclictest3281783-21head10:05:253
3219643992215,4cyclictest3278792-21sendmail-msp10:00:003
3219643992215,4cyclictest0-21swapper/312:10:253
3219643992215,3cyclictest0-21swapper/309:15:013
3219643992215,3cyclictest0-21swapper/308:45:203
3219643992214,4cyclictest3309888-21latency_hist11:30:013
3219639992216,3cyclictest0-21swapper/212:00:142
3219639992215,5cyclictest2985597-21kworker/u8:2+events_unbound09:00:132
3219631992216,3cyclictest0-21swapper/012:35:220
3219631992215,3cyclictest0-21swapper/009:06:260
321963199221,3cyclictest0-21swapper/009:41:440
321963199220,20cyclictest0-21swapper/012:05:210
3219643992115,3cyclictest3317475-21ntpq11:50:193
3219643992115,3cyclictest0-21swapper/308:20:143
3219643992115,3cyclictest0-21swapper/308:20:143
3219643992114,5cyclictest391ktimers/310:00:123
3219643992113,5cyclictest3270239-21auditctl09:35:003
321964399211,14cyclictest3328659-21munin-run12:25:003
321964399211,10cyclictest3326525-21grep12:15:243
3219639992116,3cyclictest0-21swapper/207:40:132
3219639992113,5cyclictest0-21swapper/209:30:242
3219634992115,3cyclictest0-21swapper/111:20:171
3219631992115,3cyclictest0-21swapper/010:45:240
3219631992114,3cyclictest0-21swapper/007:30:040
3219643992014,3cyclictest0-21swapper/312:30:233
3219643992014,3cyclictest0-21swapper/308:05:253
3219643992013,4cyclictest0-21swapper/308:25:263
3219643992013,4cyclictest0-21swapper/308:25:263
3219643992010,8cyclictest3252593-21sed08:40:243
3219634992014,3cyclictest0-21swapper/109:30:211
321963999193,3cyclictest131rcu_preempt10:50:142
321963999191,4cyclictest131rcu_preempt10:20:132
3219643991810,5cyclictest3260849-21/usr/sbin/munin09:05:213
3219634991812,3cyclictest0-21swapper/110:20:171
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional