You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-09-08 - 22:36

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #b, slot #5

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  Phytec
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.

Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the highest latencies:
System rackbslot5s.osadl.org (updated Tue Sep 08, 2026 12:44:47)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
3355945996642,21cyclictest3453690-21fschecks_time11:50:152
3355945995626,25cyclictest0-21swapper/211:40:162
3355945994820,24cyclictest0-21swapper/211:15:222
3355945994819,25cyclictest0-21swapper/208:40:002
3355942994836,7cyclictest3414432-21unixbench_multi09:55:251
3355937994838,6cyclictest3453714-21sshd11:50:150
3355945994736,7cyclictest3395659-21grep09:00:242
3355937994715,10cyclictest3423786-21sed10:25:020
3355948994636,7cyclictest3404659-21cron09:30:013
3355945994613,4cyclictest0-21swapper/211:50:002
3355937994520,22cyclictest629-21snmpd07:17:500
3355937994518,9cyclictest3432835-21cat10:50:190
3355945994435,6cyclictest3414944-21latency_hist10:00:002
3355937994434,6cyclictest0-21swapper/011:10:110
3355945994335,5cyclictest3468633-21idleruntime-cro12:35:002
3355945994335,5cyclictest3468633-21idleruntime-cro12:34:592
3355945994313,7cyclictest0-21swapper/208:05:202
3355937994327,11cyclictest0-21swapper/011:20:120
3355937994324,15cyclictest3394420-21idleruntime-cro09:00:000
3355937994323,7cyclictest3457378-21chrt12:00:190
3355937994319,21cyclictest3389349-21latency_hist08:45:010
3355945994235,4cyclictest438-21cron12:00:002
3355945994215,3cyclictest0-21swapper/210:20:002
3355945994130,7cyclictest3369041-21grep07:45:152
3355937994132,4cyclictest0-21swapper/009:49:480
3355937994129,7cyclictest3429569-21ntp_states10:40:210
3355937994127,9cyclictest3434354-21/usr/sbin/munin10:55:170
3355937994127,11cyclictest3356093-21munin-node07:10:120
3355937994127,10cyclictest0-21swapper/009:55:120
3355937994124,3cyclictest3421035-21ntp_states10:15:240
3355937994118,10cyclictest3387808-21cat08:40:020
3355937994116,23cyclictest0-21swapper/012:22:280
3355948994033,4cyclictest3425361-21idleruntime-cro10:30:013
3355948994032,5cyclictest3401257-21idleruntime-cro09:19:593
3355948994028,8cyclictest3456692-21sendmail12:00:003
3355945994031,5cyclictest3401271-21sendmail09:20:012
3355945994010,7cyclictest3397957-21cut09:10:012
3355937994029,8cyclictest3362607-21ntp_states07:25:210
3355937994028,9cyclictest3408412-21/usr/sbin/munin09:40:140
3355937994027,9cyclictest3372257-21munin-node07:55:120
3355937994027,10cyclictest3466482-21/usr/sbin/munin12:25:250
3355937994027,10cyclictest3466482-21/usr/sbin/munin12:25:250
3355937994027,10cyclictest3417110-21/usr/sbin/munin10:05:120
3355937994027,10cyclictest3383341-21/usr/sbin/munin08:25:230
3355937994027,10cyclictest0-21swapper/007:35:130
3355937994026,9cyclictest3398373-21/usr/sbin/munin09:10:160
3355937994026,11cyclictest3392216-21/usr/sbin/munin08:50:230
3355937994026,11cyclictest3376313-21/usr/sbin/munin08:05:230
3355937994026,10cyclictest3396699-21/usr/sbin/munin09:05:180
3355937994023,3cyclictest3461410-21users12:10:240
3355937994021,14cyclictest3408253-21latency_hist09:40:020
3355937994020,16cyclictest3382302-21cat08:25:000
3355937994020,16cyclictest3382302-21cat08:25:000
3355948993929,7cyclictest0-21swapper/309:05:013
3355945993915,3cyclictest3445767-21tail11:25:242
3355937993929,7cyclictest3402622-21cron09:21:010
3355937993926,10cyclictest3450507-21/usr/sbin/munin11:40:230
3355937993926,10cyclictest3441379-21/usr/sbin/munin11:15:170
3355937993925,11cyclictest3374067-21/usr/sbin/munin08:00:130
3355937993925,10cyclictest3389676-21/usr/sbin/munin08:45:150
3355937993924,10cyclictest3411836-21df_inode09:50:160
3355937993922,13cyclictest3399886-21/usr/sbin/munin09:15:150
3355937993920,14cyclictest3448367-21fschecks_time11:35:170
3355937993920,14cyclictest3448367-21fschecks_time11:35:170
3355937993919,17cyclictest0-21swapper/007:45:210
3355937993919,15cyclictest3405754-21timerandwakeup09:30:260
3355948993826,8cyclictest0-21swapper/309:05:263
3355948993824,11cyclictest391ktimers/307:20:143
3355945993830,4cyclictest0-21swapper/212:25:152
3355945993830,4cyclictest0-21swapper/212:25:152
3355937993828,7cyclictest3469367-21/usr/sbin/munin12:35:160
3355937993828,7cyclictest3371579-21/usr/sbin/munin07:50:230
3355937993828,7cyclictest3365024-21cron07:33:000
3355937993827,8cyclictest3428009-21/usr/sbin/munin10:35:240
3355937993827,7cyclictest3403201-21apt-get09:25:140
3355937993826,9cyclictest3437741-21/usr/sbin/munin11:05:100
3355937993826,9cyclictest3436106-21/usr/sbin/munin11:00:180
3355937993825,10cyclictest3447713-21sshd11:32:170
3355937993825,10cyclictest3447713-21sshd11:32:170
3355937993820,16cyclictest0-21swapper/011:55:110
3355937993820,15cyclictest3378086-21mailstats08:10:240
3355948993725,7cyclictest3426579-21grep10:30:283
3355945993727,4cyclictest0-21swapper/211:30:112
3355945993727,4cyclictest0-21swapper/211:30:112
3355945993726,8cyclictest3378847-21auditctl08:15:002
3355942993726,6cyclictest0-21swapper/107:15:021
3355937993727,7cyclictest3379756-21/usr/sbin/munin08:15:220
3355937993726,8cyclictest3431271-21ntp_states10:45:210
3355937993726,8cyclictest3384411-21munin-node08:30:100
3355937993726,8cyclictest3367495-21/usr/sbin/munin07:40:190
3355937993724,9cyclictest3355986-21latency_hist07:10:000
3355937993724,7cyclictest0-21swapper/009:00:120
3355937993723,8cyclictest3451864-21/usr/sbin/munin11:45:160
3355937993723,11cyclictest3425770-21/usr/sbin/munin10:30:180
3355937993723,10cyclictest3462757-21/usr/sbin/munin12:15:210
3355937993722,12cyclictest3418875-21df_inode10:10:180
3355937993722,12cyclictest3415678-21/usr/sbin/munin10:00:160
3355948993627,6cyclictest0-21swapper/308:15:253
3355948993626,7cyclictest3409362-21grep09:40:253
3355948993626,7cyclictest0-21swapper/311:20:253
3355948993625,7cyclictest0-21swapper/308:25:013
3355948993625,7cyclictest0-21swapper/308:25:003
3355948993625,7cyclictest0-21swapper/307:55:253
3355948993625,6cyclictest0-21swapper/312:25:253
3355948993625,6cyclictest0-21swapper/312:25:253
3355945993626,6cyclictest0-21swapper/207:15:012
3355945993611,8cyclictest3360235-21df_inode07:20:162
3355937993626,7cyclictest3445384-21/usr/sbin/munin11:25:220
3355937993626,7cyclictest3423879-21munin-node10:25:100
3355937993625,7cyclictest3458743-21diskstats12:05:150
3355937993621,11cyclictest3467255-21df12:30:140
3355937993621,11cyclictest3467255-21df12:30:140
3355948993526,6cyclictest3452617-21unixbench_multi11:45:253
3355948993523,9cyclictest391ktimers/308:45:133
335594299357,5cyclictest131rcu_preempt10:00:101
3355942993527,4cyclictest0-21swapper/110:55:001
3355942993527,4cyclictest0-21swapper/107:50:141
3355942993526,5cyclictest0-21swapper/107:15:161
3355942993524,7cyclictest3464786-21grep12:20:241
3355937993525,7cyclictest3360249-21entropy07:20:170
3355948993423,7cyclictest0-21swapper/311:50:233
3355945993426,4cyclictest0-21swapper/209:50:012
3355945993424,5cyclictest0-21swapper/208:34:352
3355942993427,4cyclictest0-21swapper/112:05:161
3355942993426,4cyclictest0-21swapper/111:25:141
3355942993425,5cyclictest0-21swapper/109:00:011
3355942993425,5cyclictest0-21swapper/107:35:011
3355942993425,4cyclictest0-21swapper/108:50:001
335594899337,5cyclictest0-21swapper/307:30:283
3355948993325,5cyclictest0-21swapper/309:35:013
3355948993324,4cyclictest0-21swapper/311:00:173
3355948993323,6cyclictest0-21swapper/311:30:243
3355948993323,6cyclictest0-21swapper/311:30:243
3355948993321,7cyclictest0-21swapper/309:55:263
3355948993316,13cyclictest391ktimers/309:20:123
3355945993322,7cyclictest3463030-21grep12:15:242
3355942993326,4cyclictest3468609-21cron12:34:591
3355942993326,4cyclictest3468609-21cron12:34:591
3355942993325,4cyclictest0-21swapper/108:20:191
3355942993325,4cyclictest0-21swapper/108:20:181
3355948993222,6cyclictest0-21swapper/310:35:263
3355945993225,4cyclictest0-21swapper/210:00:242
3355942993223,6cyclictest3460508-21fschecks_time12:10:151
3355948993123,4cyclictest0-21swapper/310:20:233
3355948993121,6cyclictest0-21swapper/311:15:003
3355948993120,7cyclictest0-21swapper/310:10:283
3355945993124,3cyclictest0-21swapper/209:35:272
3355945993122,5cyclictest0-21swapper/207:40:002
3355945993120,7cyclictest0-21swapper/211:20:242
3355942993123,4cyclictest0-21swapper/112:00:251
3355942993122,5cyclictest0-21swapper/111:55:251
3355942993120,7cyclictest0-21swapper/109:45:261
3355942993118,8cyclictest3465680-21grep12:25:161
3355942993118,8cyclictest3465680-21grep12:25:161
3355948993023,4cyclictest391ktimers/308:05:403
3355948993021,5cyclictest0-21swapper/308:10:263
3355942993022,4cyclictest0-21swapper/111:45:171
3355942993022,4cyclictest0-21swapper/107:55:171
3355942993020,6cyclictest3427047-21sh10:35:001
3355942993020,5cyclictest0-21swapper/108:40:271
335594899298,8cyclictest40-21ksoftirqd/307:45:213
335594899298,5cyclictest0-21swapper/309:10:253
3355948992923,3cyclictest0-21swapper/307:35:163
3355948992920,6cyclictest0-21swapper/307:40:263
3355945992922,4cyclictest0-21swapper/212:05:252
3355945992922,4cyclictest0-21swapper/208:20:012
3355945992922,3cyclictest0-21swapper/208:00:262
3355945992920,4cyclictest0-21swapper/207:25:162
3355942992923,4cyclictest3444043-21kworker/u8:2+events_unbound11:30:111
3355942992923,4cyclictest3444043-21kworker/u8:2+events_unbound11:30:111
3355942992921,5cyclictest0-21swapper/110:55:251
335594899287,5cyclictest40-21ksoftirqd/312:05:013
335594899285,8cyclictest40-21ksoftirqd/307:15:133
335594899285,6cyclictest40-21ksoftirqd/312:05:143
335594899285,5cyclictest0-21swapper/310:45:243
335594899284,6cyclictest40-21ksoftirqd/310:05:013
335594899284,6cyclictest40-21ksoftirqd/308:00:253
335594899283,7cyclictest3362515-21missed_timers07:25:193
3355948992822,3cyclictest3387589-21kthreadd08:40:013
3355948992821,4cyclictest0-21swapper/312:20:233
3355948992821,4cyclictest0-21swapper/310:55:173
3355948992818,6cyclictest0-21swapper/310:20:003
3355948992818,3cyclictest131rcu_preempt12:13:393
3355948992812,4cyclictest131rcu_preempt07:10:183
3355945992822,3cyclictest3393937-21unixbench_multi08:55:222
3355945992820,4cyclictest0-21swapper/212:35:252
3355945992820,4cyclictest0-21swapper/209:30:002
3355945992820,4cyclictest0-21swapper/208:45:262
3355945992819,5cyclictest0-21swapper/210:35:012
3355945992818,6cyclictest0-21swapper/207:15:262
335594599281,6cyclictest3411725-21apt-get09:50:122
3355942992822,4cyclictest231ktimers/111:00:151
3355942992821,4cyclictest3384189-21kthreadd08:30:011
3355942992820,4cyclictest0-21swapper/110:15:271
3355942992820,4cyclictest0-21swapper/109:05:161
3355942992819,6cyclictest3394863-21grep09:00:161
3355942992818,6cyclictest0-21swapper/108:50:151
3355948992719,5cyclictest0-21swapper/310:45:003
3355948992719,5cyclictest0-21swapper/308:35:003
3355948992711,9cyclictest131rcu_preempt11:15:123
3355945992721,3cyclictest0-21swapper/212:00:132
3355945992720,3cyclictest0-21swapper/211:35:252
3355945992720,3cyclictest0-21swapper/211:35:252
3355945992716,7cyclictest204-21dbus-daemon12:20:212
3355942992720,5cyclictest3430352-21kworker/u8:2+events_unbound10:45:011
3355942992719,4cyclictest0-21swapper/109:40:001
3355942992716,7cyclictest3418089-21grep10:05:261
3355942992716,7cyclictest0-21swapper/112:15:241
3355942992716,7cyclictest0-21swapper/110:25:231
335594899269,5cyclictest40-21ksoftirqd/307:50:193
335594899269,10cyclictest131rcu_preempt08:43:313
335594899268,11cyclictest131rcu_preempt09:35:383
335594899267,12cyclictest0-21swapper/308:59:503
3355948992616,3cyclictest131rcu_preempt10:50:553
3355948992611,5cyclictest131rcu_preempt11:25:113
3355945992619,4cyclictest0-21swapper/212:15:002
3355945992616,6cyclictest0-21swapper/208:25:272
3355942992618,4cyclictest0-21swapper/109:15:001
3355942992618,4cyclictest0-21swapper/108:30:241
3355942992617,6cyclictest3470545-21ls12:40:011
3355942992615,7cyclictest0-21swapper/107:45:201
335594899259,6cyclictest40-21ksoftirqd/312:15:173
335594899257,11cyclictest131rcu_preempt08:28:473
3355948992517,5cyclictest0-21swapper/311:10:003
3355948992510,3cyclictest131rcu_preempt12:30:583
3355948992510,3cyclictest131rcu_preempt12:30:583
3355945992518,3cyclictest3428753-21kthreadd10:40:012
3355945992517,4cyclictest3381020-21fschecks_time08:20:192
3355945992517,4cyclictest3381020-21fschecks_time08:20:192
3355945992517,4cyclictest0-21swapper/210:45:152
3355945992517,4cyclictest0-21swapper/207:55:272
335594599251,21cyclictest3392283-21unixbench_singl08:50:252
3355942992518,3cyclictest0-21swapper/108:00:161
3355942992516,6cyclictest3455101-21date11:55:011
3355942992516,6cyclictest0-21swapper/107:25:011
3355942992515,6cyclictest3387106-21grep08:35:271
3355942992512,9cyclictest3366911-21munin-run07:40:011
335594899245,12cyclictest0-21swapper/312:37:453
3355948992414,3cyclictest131rcu_preempt09:46:403
335594899241,13cyclictest0-21swapper/308:50:133
3355948992410,9cyclictest131rcu_preempt11:40:143
335594899240,16cyclictest0-21swapper/310:08:563
3355945992417,4cyclictest0-21swapper/211:00:272
3355945992415,6cyclictest0-21swapper/210:05:182
335594299243,5cyclictest131rcu_preempt09:30:121
3355942992416,6cyclictest3357390-21kworker/u8:2+events_unbound07:29:451
3355942992414,6cyclictest0-21swapper/108:20:001
3355942992411,9cyclictest231ktimers/110:10:161
3355945992316,4cyclictest0-21swapper/207:30:292
3355945992315,4cyclictest3401989-21runrttasks09:20:202
3355942992317,4cyclictest3373510-21kworker/u8:0+events_unbound08:05:361
3355942992317,3cyclictest0-21swapper/111:05:171
3355945992214,5cyclictest438-21cron07:45:002
3355945992214,5cyclictest311ktimers/210:25:012
3355945992214,5cyclictest0-21swapper/209:40:242
3355945992214,4cyclictest0-21swapper/209:10:252
3355945992213,6cyclictest0-21swapper/211:10:152
3355945992213,4cyclictest0-21swapper/210:30:012
3355942992215,4cyclictest3431738-21grep10:45:251
3355942992215,4cyclictest0-21swapper/110:40:011
3355942992214,4cyclictest0-21swapper/111:35:111
3355942992214,4cyclictest0-21swapper/111:35:101
3355945992113,6cyclictest0-21swapper/210:10:252
3355945992110,8cyclictest3371306-21sensors_temp07:50:232
3355942992115,3cyclictest3441280-21fschecks_count11:15:161
3355942992115,3cyclictest0-21swapper/109:20:171
3355942992114,4cyclictest3450452-21ntpq11:40:201
3355945992014,3cyclictest0-21swapper/210:50:232
335594299208,8cyclictest3412770-21grep09:50:261
3355942992012,5cyclictest231ktimers/109:40:131
3355945991912,5cyclictest311ktimers/210:40:142
3355945991911,5cyclictest0-21swapper/211:05:202
3355942991913,4cyclictest231ktimers/108:13:321
3355942991912,4cyclictest3400003-21fschecks_time09:15:171
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional