You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-09-19 - 23:00

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #b, slot #5

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  Phytec
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.

Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of all highest latencies:
System rackbslot5s.osadl.org (updated Sat Sep 19, 2026 12:44:47)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
3302005995125,22cyclictest0-21swapper/109:55:231
3302005994735,9cyclictest231ktimers/111:55:151
3302005994532,9cyclictest3416153-21grep12:40:001
3302005994432,8cyclictest3375883-21grep10:40:271
3302013994333,6cyclictest3402546-21fschecks_time12:00:193
3302013994133,5cyclictest3359232-21debian-sa109:55:013
3302000994134,4cyclictest3360942-21grep09:59:590
3302000994133,4cyclictest0-21swapper/011:35:000
3302013994030,7cyclictest3327654-21grep08:20:273
3302009994033,4cyclictest3312783-21sendmail07:40:012
3302000993931,3cyclictest0-21swapper/011:45:000
3302000993930,5cyclictest3412328-21munin-plugin-st12:30:000
3302000993930,5cyclictest3412328-21munin-plugin-st12:30:000
3302013993828,7cyclictest3414261-21grep12:35:003
3302005993828,8cyclictest231ktimers/111:10:131
3302000993831,3cyclictest0-21swapper/008:20:000
3302000993829,5cyclictest3351756-21grep09:30:270
3302000993731,4cyclictest3414490-21latency_hist12:35:000
3302000993730,3cyclictest0-21swapper/009:00:000
3302013993628,4cyclictest0-21swapper/311:05:163
3302013993628,4cyclictest0-21swapper/310:30:003
3302013993628,4cyclictest0-21swapper/310:25:003
3302013993628,4cyclictest0-21swapper/309:20:003
3302013993627,4cyclictest0-21swapper/310:55:173
3302013993627,4cyclictest0-21swapper/309:45:013
3302013993618,12cyclictest0-21swapper/309:55:133
3302013993611,6cyclictest40-21ksoftirqd/308:45:023
3302009993626,6cyclictest3415675-21runrttasks12:35:272
3302005993628,5cyclictest3388235-21grep11:19:591
3302000993629,4cyclictest3372046-21runrttasks10:30:230
3302000993625,7cyclictest3414856-21tune2fs12:35:170
3302009993527,4cyclictest0-21swapper/212:15:162
3302009993527,4cyclictest0-21swapper/209:25:162
3302009993524,7cyclictest3358805-21grep09:50:242
3302009993523,9cyclictest311ktimers/210:05:102
3302009993523,9cyclictest311ktimers/210:05:102
3302005993527,4cyclictest0-21swapper/108:50:011
3302000993527,5cyclictest3388642-21fschecks_count11:20:160
3302009993427,4cyclictest3303805-21munin-node07:15:022
3302009993426,4cyclictest0-21swapper/211:50:252
3302005993426,4cyclictest0-21swapper/107:40:011
3302005993425,6cyclictest3346640-21unixbench_multi09:15:271
3302000993425,5cyclictest3329398-21grep08:25:250
330201399336,11cyclictest3376304-21latency_hist10:45:023
3302013993326,4cyclictest3409314-21fschecks_count12:20:163
3302013993326,4cyclictest3409314-21fschecks_count12:20:153
3302013993324,6cyclictest3340648-21kernelversion09:00:173
3302013993324,5cyclictest0-21swapper/309:45:253
3302013993317,11cyclictest0-21swapper/310:35:143
3302009993325,4cyclictest0-21swapper/208:15:172
3302009993322,7cyclictest3407193-21sh12:15:002
3302009993321,8cyclictest3365991-21kworker/u8:2+events_unbound10:30:112
3302005993322,7cyclictest3303149-21grep07:10:261
3302000993327,3cyclictest3316174-21kthreadd07:50:010
3302000993326,3cyclictest0-21swapper/008:35:010
3302000993324,6cyclictest3399765-21grep11:50:250
3302000993322,7cyclictest0-21swapper/009:50:230
3302013993222,6cyclictest0-21swapper/310:19:593
3302013993220,9cyclictest3405030-21grep12:05:253
3302013993218,11cyclictest3302512-21/usr/sbin/munin07:10:183
3302009993224,4cyclictest0-21swapper/209:05:012
3302009993222,7cyclictest3337905-21grep08:50:252
3302009993222,7cyclictest3321686-21tune2fs08:05:162
3302009993220,8cyclictest311ktimers/211:45:132
3302005993225,4cyclictest0-21swapper/110:20:261
3302005993222,6cyclictest0-21swapper/111:55:011
3302000993222,6cyclictest3380942-21unixbench_multi10:55:270
3302000993222,6cyclictest0-21swapper/012:00:000
3302000993215,15cyclictest11-21ksoftirqd/008:35:130
3302013993123,4cyclictest0-21swapper/307:25:263
3302013993120,8cyclictest204-21dbus-daemon08:05:133
3302009993123,4cyclictest0-21swapper/210:10:172
3302005993123,4cyclictest0-21swapper/112:20:001
3302000993124,4cyclictest0-21swapper/008:20:270
3302000993123,6cyclictest11-21ksoftirqd/010:25:130
3302000993121,6cyclictest3336221-21grep08:45:270
3302013993022,4cyclictest3362886-21apt-get10:05:123
3302013993022,4cyclictest3362886-21apt-get10:05:123
3302013993022,4cyclictest0-21swapper/312:35:263
3302013993022,4cyclictest0-21swapper/308:30:003
3302013993021,6cyclictest3398910-21cut11:50:153
3302013993019,9cyclictest3398460-21cron11:50:003
3302013993019,7cyclictest3324924-21/usr/sbin/munin08:15:123
3302013993016,11cyclictest3323222-21munin-node08:10:133
3302013993013,13cyclictest0-21swapper/307:30:223
3302009993023,3cyclictest0-21swapper/209:40:002
3302009993022,4cyclictest0-21swapper/210:55:172
3302009993022,4cyclictest0-21swapper/208:40:282
3302009993019,6cyclictest0-21swapper/211:20:172
3302009993019,5cyclictest3375901-21unixbench_singl10:40:282
3302000993020,6cyclictest0-21swapper/009:45:160
3302013992923,3cyclictest3331746-21apt-get08:35:143
3302013992918,8cyclictest3386756-21apt-get11:15:133
3302013992917,9cyclictest3351038-21/usr/sbin/munin09:30:183
3302013992917,9cyclictest3347774-21/usr/sbin/munin09:20:203
3302013992916,10cyclictest3385110-21/usr/sbin/munin11:10:163
3302013992914,3cyclictest3364700-21df_inode10:10:163
3302013992911,14cyclictest3396778-21grep11:45:013
3302009992921,6cyclictest3277637-21kworker/u8:0+events_unbound07:45:052
3302009992921,5cyclictest0-21swapper/207:45:012
3302009992921,4cyclictest3356041-21fschecks_time09:45:162
3302009992921,3cyclictest0-21swapper/210:20:002
3302009992916,10cyclictest311ktimers/207:30:122
3302005992922,4cyclictest3357327-21kthreadd09:50:001
3302005992921,4cyclictest0-21swapper/110:25:251
3302000992924,3cyclictest3396453-21kworker/u8:1+events_unbound11:45:440
3302000992923,3cyclictest3341842-21latency_hist09:05:000
3302000992923,3cyclictest0-21swapper/011:40:000
3302000992922,4cyclictest3407209-21munin-plugin-st12:14:590
3302000992922,4cyclictest3324685-21sh08:15:000
3302000992921,5cyclictest3309277-21kworker/u8:1+events_unbound07:30:010
3302000992921,5cyclictest0-21swapper/010:15:260
3302000992919,7cyclictest3317478-21grep07:50:280
3302000992919,6cyclictest0-21swapper/009:15:280
3302000992910,4cyclictest3342092-21cat09:05:020
330201399289,4cyclictest0-21swapper/308:57:243
3302013992822,3cyclictest3306186-21apt-get07:20:133
3302013992820,5cyclictest0-21swapper/311:30:193
3302013992820,4cyclictest0-21swapper/311:25:273
3302013992820,4cyclictest0-21swapper/311:25:263
3302013992819,6cyclictest3361189-21apt-get10:00:133
3302013992816,8cyclictest0-21swapper/309:35:183
3302013992815,10cyclictest3410968-21/usr/sbin/munin12:25:163
3302013992815,10cyclictest3410968-21/usr/sbin/munin12:25:163
3302013992811,14cyclictest3372463-21grep10:30:263
3302013992810,13cyclictest3320870-21grep08:00:253
3302013992810,13cyclictest3320870-21grep08:00:243
3302009992821,3cyclictest0-21swapper/212:10:002
3302009992820,3cyclictest0-21swapper/208:00:012
3302009992819,5cyclictest3331959-21fschecks_time08:35:162
3302005992818,7cyclictest0-21swapper/109:35:011
3302000992822,3cyclictest0-21swapper/010:10:260
3302000992821,4cyclictest3388264-21idleruntime-cro11:19:590
3302000992818,7cyclictest3354991-21seq09:40:240
330201399279,15cyclictest3377141-21/usr/sbin/munin10:45:233
330201399279,15cyclictest3336871-21cpu08:50:143
3302013992717,8cyclictest3318110-21munin-node07:55:133
3302013992717,7cyclictest3393763-21/usr/sbin/munin11:35:183
3302013992717,7cyclictest3378229-21munin-node10:50:123
3302013992717,7cyclictest3345037-21cron09:11:013
3302013992716,8cyclictest3314034-21/usr/sbin/munin07:40:253
3302013992711,13cyclictest3314944-21fschecks_time07:45:183
3302013992710,14cyclictest3401060-21sshd11:55:223
3302013992710,13cyclictest3336197-21grep08:45:273
3302009992721,3cyclictest3387753-21unixbench_multi11:15:262
3302009992718,6cyclictest0-21swapper/211:55:172
3302009992718,5cyclictest0-21swapper/208:50:012
3302009992715,7cyclictest3403399-21grep12:00:272
3302005992721,4cyclictest3301993-21cyclictest09:05:131
3302005992720,4cyclictest0-21swapper/108:20:261
3302005992719,4cyclictest0-21swapper/112:25:001
3302005992719,4cyclictest0-21swapper/112:25:001
3302005992718,5cyclictest0-21swapper/111:35:271
3302000992720,3cyclictest0-21swapper/010:20:250
3302013992617,6cyclictest3311407-21/usr/sbin/munin07:35:143
3302013992616,7cyclictest3407771-21/usr/sbin/munin12:15:173
3302013992616,7cyclictest3330165-21/usr/sbin/munin08:30:143
3302013992616,7cyclictest3316410-21/usr/sbin/munin07:50:143
3302009992620,3cyclictest0-21swapper/209:10:162
3302009992617,6cyclictest3413167-21wc12:30:192
3302009992616,6cyclictest3394596-21grep11:35:282
3302009992616,6cyclictest0-21swapper/207:55:002
330200999261,5cyclictest131rcu_preempt12:20:122
330200999261,5cyclictest131rcu_preempt12:20:112
3302005992618,5cyclictest0-21swapper/110:55:271
3302005992618,4cyclictest0-21swapper/108:50:151
3302000992620,3cyclictest0-21swapper/008:00:240
3302000992620,3cyclictest0-21swapper/008:00:240
3302000992618,4cyclictest3333807-21sshd08:40:210
330200099261,7cyclictest33450732sleep009:11:240
3302000992617,6cyclictest3359705-1kworker/0:1H+mmc_complete10:55:000
3302000992617,4cyclictest0-21swapper/010:40:280
330201399255,14cyclictest40-21ksoftirqd/311:20:183
3302013992515,7cyclictest3406179-21/usr/sbin/munin12:10:213
3302013992513,9cyclictest3342648-21meminfo09:05:203
3302009992519,3cyclictest0-21swapper/207:15:222
3302009992517,5cyclictest0-21swapper/209:15:282
3302005992518,3cyclictest0-21swapper/109:40:201
3302005992517,5cyclictest3412329-21munin-plugin-st12:29:591
3302005992517,5cyclictest3412329-21munin-plugin-st12:29:591
3302005992517,4cyclictest0-21swapper/112:05:241
3302000992520,2cyclictest13550irq/42-30be0000.ethernet07:40:000
3302000992519,3cyclictest3390530-21runrttasks11:25:200
3302000992519,3cyclictest3390530-21runrttasks11:25:200
3302000992519,3cyclictest0-21swapper/011:10:180
3302000992518,4cyclictest13550irq/42-30be0000.ethernet09:40:010
3302000992516,6cyclictest3382674-21grep11:00:250
3302013992414,7cyclictest3349594-21ntp_states09:25:203
3302009992418,3cyclictest0-21swapper/207:20:202
3302009992417,4cyclictest3331087-21grep08:30:262
3302009992416,5cyclictest0-21swapper/209:25:012
3302009992416,5cyclictest0-21swapper/208:25:262
3302009992415,6cyclictest0-21swapper/211:45:012
3302009992414,6cyclictest3383509-21tune2fs11:05:152
3302009992413,8cyclictest3382216-21ntp_states11:00:212
330200999241,20cyclictest3412492-21apt-key12:30:012
330200999241,20cyclictest3412492-21apt-key12:30:002
3302005992419,3cyclictest3340689-21latency09:00:181
3302005992418,4cyclictest0-21swapper/110:05:111
3302005992418,4cyclictest0-21swapper/110:05:101
3302005992417,4cyclictest0-21swapper/109:50:231
3302005992417,4cyclictest0-21swapper/108:55:211
3302005992413,8cyclictest3331941-21cut08:35:171
3302000992418,3cyclictest0-21swapper/010:00:270
3302000992418,2cyclictest0-21swapper/007:16:050
3302000992416,6cyclictest3346814-21kworker/u8:0+events_unbound09:20:280
3302000992414,6cyclictest3408927-21basename12:19:590
3302000992412,7cyclictest0-21swapper/012:05:470
330200099241,19cyclictest0-21swapper/012:02:170
330200099241,19cyclictest0-21swapper/010:37:350
330200099241,19cyclictest0-21swapper/007:24:170
3302009992318,3cyclictest3378432-21fschecks_time10:50:172
3302009992317,3cyclictest0-21swapper/210:45:262
3302009992316,3cyclictest0-21swapper/210:40:002
3302009992316,3cyclictest0-21swapper/209:30:192
3302009992314,6cyclictest3321285-21sh08:05:012
3302009992314,6cyclictest3321285-21sh08:05:012
3302009992314,5cyclictest0-21swapper/208:14:592
3302009992313,7cyclictest3391194-21grep11:25:272
3302009992313,7cyclictest3391194-21grep11:25:262
3302009992313,7cyclictest3361954-21expr10:00:262
3302005992317,3cyclictest0-21swapper/111:45:231
3302005992317,3cyclictest0-21swapper/110:00:281
3302005992317,3cyclictest0-21swapper/107:40:251
3302005992316,4cyclictest3347871-21ntpq09:20:211
3302005992316,4cyclictest0-21swapper/107:15:241
3302005992316,3cyclictest0-21swapper/108:20:001
3302005992315,4cyclictest0-21swapper/112:00:171
3302005992315,4cyclictest0-21swapper/110:30:171
3302000992318,3cyclictest3309751-21fschecks_count07:30:150
3302000992315,5cyclictest0-21swapper/008:50:240
330200099231,3cyclictest0-21swapper/010:05:190
330200099231,3cyclictest0-21swapper/010:05:190
330200099231,18cyclictest0-21swapper/012:21:270
330200099231,18cyclictest0-21swapper/012:21:270
330200099231,18cyclictest0-21swapper/007:57:270
3302009992216,3cyclictest0-21swapper/211:10:412
3302009992216,3cyclictest0-21swapper/207:25:262
3302009992215,3cyclictest0-21swapper/211:30:182
3302005992216,3cyclictest0-21swapper/111:25:241
3302005992216,3cyclictest0-21swapper/111:25:241
3302005992216,3cyclictest0-21swapper/111:20:261
3302005992216,3cyclictest0-21swapper/111:00:221
3302005992216,3cyclictest0-21swapper/110:50:241
3302005992216,3cyclictest0-21swapper/110:35:201
3302005992216,3cyclictest0-21swapper/109:35:211
3302005992215,4cyclictest0-21swapper/107:55:201
3302005992214,5cyclictest231ktimers/112:30:131
3302005992213,5cyclictest0-21swapper/107:25:251
3302005992210,8cyclictest0-21swapper/111:30:191
3302000992217,3cyclictest0-21swapper/010:45:060
3302000992215,3cyclictest0-21swapper/007:10:230
330200099221,17cyclictest0-21swapper/009:27:060
3302009992115,3cyclictest0-21swapper/209:55:152
3302009992115,3cyclictest0-21swapper/209:05:232
3302009992114,5cyclictest0-21swapper/208:20:162
330200599212,14cyclictest3323231-21sshd08:10:151
3302005992116,3cyclictest0-21swapper/112:10:201
3302005992115,4cyclictest231ktimers/109:14:051
3302005992115,3cyclictest3314874-21fschecks_count07:45:181
3302005992115,3cyclictest0-21swapper/110:10:251
3302005992115,3cyclictest0-21swapper/109:25:191
3302005992114,4cyclictest0-21swapper/107:30:241
330200099213,16cyclictest0-21swapper/008:05:170
3302000992115,4cyclictest121ktimers/011:05:240
330200999209,8cyclictest3368121-21df_inode10:20:152
330200599204,3cyclictest0-21swapper/108:08:161
330200599202,14cyclictest3331122-21head08:30:261
3302005992014,3cyclictest0-21swapper/108:05:011
3302005992014,3cyclictest0-21swapper/108:05:011
3302005992011,7cyclictest3376871-21kernelversion10:45:181
3302005992010,7cyclictest3317633-21seq07:52:121
3302005992010,6cyclictest1-21systemd08:25:181
330200099200,18cyclictest0-21swapper/007:44:060
330200999190,17cyclictest311ktimers/208:55:152
3302005991812,3cyclictest3366511-21fschecks_time10:15:181
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional