You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-08-06 - 16:35

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #b, slot #5

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  Phytec
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.

Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the highest latencies:
System rackbslot5s.osadl.org (updated Thu Aug 06, 2026 12:44:51)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
3522999996154,5cyclictest3547380-21kworker/u8:0+events_unbound08:25:212
3522994995538,12cyclictest231ktimers/110:05:151
3522994995538,12cyclictest231ktimers/110:05:141
3523003995445,6cyclictest164-21systemd-journal08:45:243
3523003995138,11cyclictest391ktimers/309:20:133
3522999995137,10cyclictest311ktimers/207:55:142
3522990995143,5cyclictest3583653-21munin-plugin-st10:05:010
3523003994640,4cyclictest3528259-21kworker/u8:0+events_unbound07:24:593
3523003994637,5cyclictest3571710-21idleruntime-cro09:30:003
3523003994634,8cyclictest3609445-21sendmail11:20:003
352299499461,12cyclictest3525454-21apt-get07:15:111
3523003994536,7cyclictest3624731-21kworker/u8:1+events_unbound12:05:553
3523003994437,5cyclictest3633262-21kworker/u8:0+events_unbound12:36:003
3523003994335,6cyclictest3633262-21kworker/u8:0+events_unbound12:30:593
352299499431,9cyclictest3551480-21/usr/sbin/munin08:30:151
3522999994231,7cyclictest3611541-21fschecks_count11:25:142
3522999994231,7cyclictest3611541-21fschecks_count11:25:142
3522999994228,10cyclictest311ktimers/211:40:112
3522994994233,5cyclictest0-21swapper/108:25:201
3522994994214,25cyclictest3575350-21/usr/sbin/munin09:40:241
352299499421,10cyclictest3536021-21/usr/sbin/munin07:45:151
3523003994126,12cyclictest391ktimers/310:45:123
3523003994126,10cyclictest391ktimers/307:45:123
352299499412,35cyclictest3546337-21grep08:15:161
352299499411,3cyclictest0-21swapper/111:15:131
3523003994032,6cyclictest3550881-21kworker/u8:2+events_unbound08:44:423
352300399402,7cyclictest0-21swapper/309:35:123
352300399402,7cyclictest0-21swapper/309:35:113
3522999994030,6cyclictest3631366-21unixbench_multi12:20:232
352299499402,33cyclictest3595772-21cron10:40:001
352299499401,9cyclictest3572022-21/usr/sbin/munin09:30:141
352299499401,8cyclictest3596307-21/usr/sbin/munin10:40:161
352299499401,4cyclictest0-21swapper/108:40:131
352299499401,3cyclictest0-21swapper/111:25:101
352299499401,3cyclictest0-21swapper/111:25:101
352299499401,34cyclictest3585926-21fschecks_count10:10:151
352299499401,34cyclictest3585926-21fschecks_count10:10:151
352299499401,10cyclictest3603693-21/usr/sbin/munin11:00:251
352299499401,10cyclictest3565557-21memory09:10:201
352299499400,9cyclictest36012392df10:55:141
352299499400,3cyclictest0-21swapper/107:55:141
352299999391,15cyclictest32-21ksoftirqd/207:50:122
352299499393,9cyclictest3621729-21/usr/sbin/munin11:55:161
352299499392,6cyclictest3627043-21df_inode12:10:141
352299499391,9cyclictest3531026-21memory07:30:191
352299499391,9cyclictest3531026-21memory07:30:191
352299499391,7cyclictest3634294-21/usr/sbin/munin12:30:201
352299499391,6cyclictest3606368-21df_inode11:10:151
352299499391,5cyclictest3623321-21apt-get12:00:121
352299499391,4cyclictest0-21swapper/109:15:101
352299499391,3cyclictest0-21swapper/112:05:131
352299499391,3cyclictest0-21swapper/111:30:111
352299499391,3cyclictest0-21swapper/111:30:111
3522994993912,22cyclictest3542716-21/usr/sbin/munin08:05:151
352299499391,11cyclictest3533283-21grep07:35:231
352299499391,10cyclictest3578860-21df09:50:131
352299499390,3cyclictest0-21swapper/110:15:121
3522990993931,5cyclictest3551012-21sh08:30:000
3523003993832,4cyclictest3580444-21kworker/u8:1+events_unbound09:55:373
3523003993829,7cyclictest3587027-21kworker/u8:0+events_unbound10:25:403
3522999993824,10cyclictest311ktimers/211:00:132
3522994993825,9cyclictest3583192-21grep10:00:251
352299499382,4cyclictest3604897-21/usr/sbin/munin11:05:181
352299499382,31cyclictest3592796-21cut10:30:171
352299499381,9cyclictest3635567-21df_inode12:35:141
352299499381,9cyclictest3569369-21grep09:20:241
352299499381,9cyclictest3529439-21/usr/sbin/munin07:25:221
352299499381,8cyclictest3618210-21egrep11:45:131
352299499381,8cyclictest3558384-21/usr/sbin/munin08:50:141
352299499381,6cyclictest3553968-21unixbench_multi08:35:271
352299499381,6cyclictest3553968-21unixbench_multi08:35:261
352299499381,4cyclictest3632135-21/usr/sbin/munin12:25:131
352299499381,4cyclictest3632135-21/usr/sbin/munin12:25:131
352299499381,4cyclictest3589214-21/usr/sbin/munin10:20:121
352299499381,4cyclictest3541710-21/usr/sbin/munin08:00:231
352299499381,3cyclictest0-21swapper/112:20:111
352299499381,3cyclictest0-21swapper/110:25:121
352299499381,32cyclictest3557419-21head08:45:251
352299499381,2cyclictest3628627-21apt-get12:15:091
352299499381,11cyclictest3598279-21tr10:45:201
352299499380,9cyclictest3538569-21sed07:50:261
352299499380,3cyclictest0-21swapper/109:25:111
352299499380,3cyclictest0-21swapper/107:20:121
3522990993829,6cyclictest3629678-21grep12:15:230
3523003993731,4cyclictest3592320-21kworker/u8:2+events_unbound10:35:423
3523003993731,4cyclictest3580444-21kworker/u8:1+events_unbound10:05:383
3523003993731,4cyclictest3580444-21kworker/u8:1+events_unbound10:05:383
3523003993727,7cyclictest3612434-21grep11:25:233
3523003993727,7cyclictest3612434-21grep11:25:233
3522999993727,7cyclictest3635220-21auditctl12:35:002
3522999993726,7cyclictest0-21swapper/212:00:152
352299499371,9cyclictest3609795-21diskstats11:20:151
352299499371,9cyclictest3599666-21fw_packets10:50:151
352299499371,9cyclictest3562778-21sshd09:00:261
352299499371,9cyclictest3548004-21cut08:20:151
352299499371,9cyclictest3523261-21df_inode07:10:131
352299499371,4cyclictest3545114-21/usr/sbin/munin08:10:231
352299499371,3cyclictest0-21swapper/109:55:121
352299499371,10cyclictest3617195-21/usr/sbin/munin11:40:221
352299499371,10cyclictest3535461-21latency_hist07:45:011
3522990993728,7cyclictest3621740-21fschecks_count11:55:170
3523003993630,4cyclictest3571464-21kworker/u8:1+events_unbound09:30:353
3523003993629,5cyclictest391ktimers/310:40:113
3523003993611,8cyclictest40-21ksoftirqd/311:40:003
3522999993628,4cyclictest0-21swapper/210:55:162
3522999993628,4cyclictest0-21swapper/208:50:252
352299499361,4cyclictest3563408-21/usr/sbin/munin09:05:141
352299499361,3cyclictest0-21swapper/108:55:111
352299499361,10cyclictest3620453-21ntpq11:50:201
3523003993527,4cyclictest0-21swapper/311:20:163
3523003993527,4cyclictest0-21swapper/307:40:003
3523003993526,5cyclictest0-21swapper/309:05:003
3523003993525,6cyclictest0-21swapper/307:40:243
3522999993528,4cyclictest3547610-21idleruntime-cro08:20:002
352299499352,3cyclictest3573634-21apt-get09:35:121
352299499352,3cyclictest3573634-21apt-get09:35:121
352299499351,6cyclictest3577126-21cat09:45:131
352299499351,4cyclictest3615854-21/usr/sbin/munin11:35:241
3523003993420,5cyclictest131rcu_preempt07:25:143
352300399341,12cyclictest0-21swapper/311:00:123
3522999993426,4cyclictest0-21swapper/207:35:232
3522999993425,6cyclictest3596244-21fschecks_time10:40:152
3522999993424,6cyclictest0-21swapper/212:30:002
3522999993424,6cyclictest0-21swapper/212:30:002
352299499341,5cyclictest3523107-21latency_hist07:10:011
3523003993322,7cyclictest0-21swapper/307:15:013
3523003993312,12cyclictest40-21ksoftirqd/309:55:013
3523003993311,13cyclictest40-21ksoftirqd/308:10:233
3522999993324,6cyclictest3561039-21unixbench_singl08:55:252
3522999993323,6cyclictest0-21swapper/211:55:002
3522999993323,6cyclictest0-21swapper/207:10:242
3522999993322,7cyclictest0-21swapper/209:30:262
3522990993325,4cyclictest0-21swapper/010:25:250
3522990993324,6cyclictest3587624-21fschecks_count10:15:150
3522990993321,8cyclictest3636451-21grep12:35:240
3523003993222,6cyclictest0-21swapper/311:45:233
3523003993215,5cyclictest131rcu_preempt08:50:213
3523003993212,12cyclictest40-21ksoftirqd/307:55:023
3523003993211,5cyclictest131rcu_preempt09:10:263
3522999993224,4cyclictest0-21swapper/209:00:162
3522999993224,4cyclictest0-21swapper/207:24:572
3522999993223,4cyclictest0-21swapper/212:15:232
3522990993226,3cyclictest3552727-21munin-plugin-st08:35:000
3522990993225,5cyclictest3550881-21kworker/u8:2+events_unbound08:35:230
3522990993225,5cyclictest3550881-21kworker/u8:2+events_unbound08:35:230
3522990993225,4cyclictest0-21swapper/010:45:160
3522990993223,6cyclictest0-21swapper/011:20:000
3522990993222,7cyclictest3616251-21latency_hist11:40:000
3523003993125,4cyclictest3564858-21kworker/u8:1+events_unbound09:15:313
3523003993119,5cyclictest131rcu_preempt10:20:173
352300399311,5cyclictest0-21swapper/309:05:123
3523003993112,8cyclictest3538709-21kworker/u8:1+events_unbound07:55:093
3523003993112,12cyclictest131rcu_preempt12:20:143
352300399311,14cyclictest40-21ksoftirqd/312:10:113
3522999993125,4cyclictest3524568-21kworker/u8:2+events_unbound07:29:582
3522999993123,4cyclictest0-21swapper/209:55:012
3522999993123,4cyclictest0-21swapper/208:40:232
3522999993122,6cyclictest3569996-21sh09:25:002
3522999993121,7cyclictest3623088-21idleruntime-cro12:00:002
3522999993121,6cyclictest0-21swapper/207:45:252
3522999993120,8cyclictest311ktimers/209:05:122
3522999993119,9cyclictest311ktimers/208:30:112
3522990993121,7cyclictest3585941-21tune2fs10:10:150
3522990993121,7cyclictest3585941-21tune2fs10:10:150
352300399307,11cyclictest131rcu_preempt07:30:193
352300399307,11cyclictest131rcu_preempt07:30:193
3523003993023,5cyclictest3609260-21kworker/u8:3+events_unbound12:02:433
3523003993021,5cyclictest0-21swapper/312:30:013
3523003993021,5cyclictest0-21swapper/312:30:003
3523003993012,5cyclictest131rcu_preempt10:30:253
3523003993010,12cyclictest131rcu_preempt08:20:143
3523003993010,11cyclictest0-21swapper/311:31:383
3523003993010,11cyclictest0-21swapper/311:31:383
3522999993024,4cyclictest3609260-21kworker/u8:3+events_unbound11:20:482
3522999993022,4cyclictest0-21swapper/207:15:242
3522999993021,7cyclictest3542956-21fschecks_time08:05:152
3522999993021,5cyclictest0-21swapper/211:45:232
3522999993021,5cyclictest0-21swapper/209:10:162
3522990993024,4cyclictest3573234-21kworker/u8:2+events_unbound09:50:360
352300399299,12cyclictest131rcu_preempt10:55:263
352300399297,13cyclictest40-21ksoftirqd/311:55:263
3523003992921,5cyclictest208-21systemd-logind08:30:213
3523003992919,6cyclictest0-21swapper/310:10:243
3523003992919,6cyclictest0-21swapper/310:10:243
3523003992917,9cyclictest3522981-21cyclictest11:40:113
3523003992916,5cyclictest131rcu_preempt11:10:123
3523003992913,9cyclictest0-21swapper/312:19:463
3523003992912,4cyclictest131rcu_preempt10:50:113
3523003992912,11cyclictest40-21ksoftirqd/311:55:013
3523003992911,11cyclictest131rcu_preempt08:40:003
3523003992911,11cyclictest131rcu_preempt08:40:003
3523003992910,11cyclictest131rcu_preempt09:45:253
3522999992920,7cyclictest3583347-21kworker/u8:0+events_unbound10:05:012
3522999992919,6cyclictest0-21swapper/211:15:262
3522999992914,8cyclictest131rcu_preempt11:05:152
3522999992914,6cyclictest3542165-21kworker/u8:1+events_unbound08:10:162
3522999992910,8cyclictest131rcu_preempt08:50:002
3522990992923,4cyclictest3574974-21kworker/u8:0+events_unbound09:40:360
3522990992922,4cyclictest3528656-21idleruntime-cro07:25:010
3522990992922,4cyclictest0-21swapper/009:35:000
3522990992922,4cyclictest0-21swapper/007:10:240
3522990992921,4cyclictest0-21swapper/011:00:000
352300399287,12cyclictest40-21ksoftirqd/308:15:243
352300399286,7cyclictest40-21ksoftirqd/308:05:193
352300399285,7cyclictest40-21ksoftirqd/309:45:003
3523003992815,5cyclictest131rcu_preempt11:05:233
3523003992813,8cyclictest131rcu_preempt10:00:173
3522999992822,4cyclictest3612762-21kworker/u8:1+events_unbound11:36:412
3522999992822,4cyclictest3550881-21kworker/u8:2+events_unbound08:39:002
3522999992822,4cyclictest3550881-21kworker/u8:2+events_unbound08:39:002
3522999992821,5cyclictest3576747-21kworker/u8:3+events_unbound09:44:312
3522999992820,5cyclictest3605823-21kworker/u8:1+events_unbound11:10:192
3522999992813,8cyclictest131rcu_preempt10:40:012
3522990992822,3cyclictest0-21swapper/008:20:000
3522990992821,3cyclictest0-21swapper/008:20:190
3522990992820,5cyclictest3607258-21tail11:10:250
3522990992820,4cyclictest0-21swapper/011:30:250
3522990992820,4cyclictest0-21swapper/011:30:240
3523003992713,5cyclictest131rcu_preempt10:15:183
3523003992711,5cyclictest131rcu_preempt08:00:153
3522999992720,3cyclictest0-21swapper/211:30:482
3522999992720,3cyclictest0-21swapper/211:30:482
3522999992717,6cyclictest0-21swapper/210:25:162
3522990992721,3cyclictest0-21swapper/010:40:000
3522990992721,3cyclictest0-21swapper/010:00:020
352299099272,11cyclictest3563183-21awk09:05:000
3522990992720,5cyclictest3530022-21kworker/u8:1+events_unbound07:34:590
3522990992720,5cyclictest3530022-21kworker/u8:1+events_unbound07:34:590
352300399268,11cyclictest131rcu_preempt08:55:193
352299099262,4cyclictest3542830-21df_inode08:05:130
3522990992620,3cyclictest0-21swapper/011:20:160
3522990992619,5cyclictest3540427-21kworker/u8:0+events_unbound08:10:180
3522990992619,4cyclictest13550irq/42-30be0000.ethernet07:40:000
3522990992618,6cyclictest3629201-21kworker/u8:1+events_unbound12:22:280
3522990992618,4cyclictest0-21swapper/007:20:010
352299099261,6cyclictest3557866-21wc08:50:000
3522990992616,7cyclictest3536139-21tune2fs07:45:170
352299999252,20cyclictest3548009-21fschecks_count08:20:152
3522999992519,4cyclictest3596024-21kworker/u8:0+events_unbound10:48:252
3522999992519,4cyclictest3580659-21grep09:55:172
3522999992519,4cyclictest3564858-21kworker/u8:1+events_unbound09:18:192
3522999992518,5cyclictest3592320-21kworker/u8:2+events_unbound10:50:412
3522999992518,4cyclictest0-21swapper/207:35:002
3522999992518,4cyclictest0-21swapper/207:35:002
3522999992517,5cyclictest0-21swapper/210:15:252
3522999992517,5cyclictest0-21swapper/209:45:252
352299999251,19cyclictest3626932-21taskset12:10:122
3522990992519,4cyclictest121ktimers/011:40:190
3522990992518,4cyclictest3593609-21tail10:30:250
3522990992516,6cyclictest0-21swapper/009:25:250
3522990992516,6cyclictest0-21swapper/007:45:010
352299999245,8cyclictest32-21ksoftirqd/210:20:212
3522999992418,4cyclictest311ktimers/209:35:132
3522999992418,4cyclictest311ktimers/209:35:132
3522999992418,3cyclictest0-21swapper/210:05:382
3522999992418,3cyclictest0-21swapper/210:05:372
3522999992416,5cyclictest0-21swapper/212:05:172
3522999992416,4cyclictest0-21swapper/208:00:252
352299099243,2cyclictest0-21swapper/011:25:200
352299099243,2cyclictest0-21swapper/011:25:200
3522990992418,3cyclictest3599641-21fschecks_time10:50:150
3522990992418,3cyclictest0-21swapper/011:45:230
3522990992418,3cyclictest0-21swapper/010:05:260
3522990992418,3cyclictest0-21swapper/010:05:260
3522990992417,3cyclictest0-21swapper/009:17:460
3522990992417,3cyclictest0-21swapper/009:10:160
3522990992417,3cyclictest0-21swapper/007:56:360
3522990992415,6cyclictest3529932-21unixbench_singl07:25:260
352299099240,20cyclictest0-21swapper/012:07:470
352299099240,20cyclictest0-21swapper/009:49:490
3522999992317,4cyclictest3633262-21kworker/u8:0+events_unbound12:35:052
3522999992316,5cyclictest3580444-21kworker/u8:1+events_unbound10:30:152
3522999992314,6cyclictest311ktimers/209:25:122
3522999992312,8cyclictest3535566-21cat07:45:012
3522990992317,2cyclictest0-21swapper/011:05:200
3522990992316,3cyclictest0-21swapper/011:03:410
352299099231,3cyclictest3563516-21df_inode09:05:150
352299099231,3cyclictest3559980-21apt-get08:55:120
352299099231,20cyclictest0-21swapper/007:50:190
3522990992311,8cyclictest204-21dbus-daemon10:40:430
352299099231,18cyclictest0-21swapper/010:21:580
352299099231,18cyclictest0-21swapper/009:39:590
352299099231,18cyclictest0-21swapper/009:39:580
352299099230,19cyclictest0-21swapper/012:11:060
352299099221,8cyclictest3541974-21ls08:00:250
3522990992216,3cyclictest13850irq/36-mmc109:25:000
3522990992216,3cyclictest0-21swapper/011:50:230
3522990992213,6cyclictest0-21swapper/012:25:140
3522990992213,6cyclictest0-21swapper/012:25:140
352299099221,19cyclictest0-21swapper/008:53:280
3522990992211,8cyclictest3633972-21cut12:30:150
3522999992111,4cyclictest131rcu_preempt10:10:132
3522999992111,4cyclictest131rcu_preempt10:10:132
3522990992114,5cyclictest0-21swapper/012:00:210
3522990992112,6cyclictest0-21swapper/008:40:200
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional