You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-09-18 - 09:24

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #b, slot #5

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  Phytec
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.

Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the 792 highest latencies:
System rackbslot5s.osadl.org (updated Fri Sep 18, 2026 00:44:49)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
3514211995344,7cyclictest3575737-21fschecks_time22:05:151
3514208995137,10cyclictest121ktimers/023:10:130
3514220994943,4cyclictest3571549-21kworker/u8:0+events_unbound22:07:483
3514220994842,4cyclictest3563116-21kworker/u8:3+events_unbound21:27:433
3514220994842,4cyclictest3545526-21kworker/u8:3+events_unbound20:37:343
3514220994842,4cyclictest3531932-21kworker/u8:0+events_unbound20:17:293
351421699481,29cyclictest3572240-21fschecks_count21:55:172
351421699470,29cyclictest3535955-21seq20:10:142
351421699462,38cyclictest3603029-21apt-get23:25:132
351421699461,29cyclictest3555736-21cat21:05:252
3514216994528,13cyclictest0-21swapper/223:55:262
351421699451,26cyclictest3617333-21perl00:05:172
3514211994538,5cyclictest3582087-21kworker/u8:1+events_unbound22:47:551
3514211994538,5cyclictest3571549-21kworker/u8:0+events_unbound22:17:491
3514211994538,5cyclictest3552866-21kworker/u8:0+events_unbound21:07:391
3514211994536,5cyclictest3535194-21unixbench_singl20:05:261
3514208994537,5cyclictest3524769-21unixbench_singl19:35:260
3514220994438,4cyclictest3515729-21kworker/u8:1+events_unbound19:17:243
3514216994436,4cyclictest3544155-21audit_send_reply20:35:002
3514216994427,13cyclictest0-21swapper/221:50:152
3514216994416,25cyclictest3560039-21latency_hist21:20:002
351421699441,38cyclictest3618928-21entropy00:10:192
3514211994429,11cyclictest231ktimers/123:35:111
3514208994434,6cyclictest0-21swapper/022:05:010
351421699433,22cyclictest3527243-21df_inode19:45:152
351421699431,37cyclictest3522011-21apt-get19:30:122
3514220994234,6cyclictest3531932-21kworker/u8:0+events_unbound20:02:303
351421699422,37cyclictest3561877-21/usr/sbin/munin21:25:252
351421699422,35cyclictest3516187-21latency_hist19:15:012
351421699421,38cyclictest3560852-21/usr/sbin/munin21:20:222
351421699421,38cyclictest3521608-21cron19:28:012
351421699421,36cyclictest3598141-21/usr/sbin/munin23:10:152
351421699421,35cyclictest3623926-21apt-get00:25:132
351421699421,23cyclictest3534724-21ntp_states20:05:222
351421699420,37cyclictest3544386-21apt-get20:35:142
3514211994236,4cyclictest3582087-21kworker/u8:1+events_unbound23:02:591
3514211994232,4cyclictest3626738-21kworker/u8:0+events_unbound00:37:361
3514211994232,4cyclictest3626738-21kworker/u8:0+events_unbound00:37:361
3514220994133,6cyclictest3535964-21kworker/u8:2+events_unbound20:12:313
351421699413,33cyclictest3580397-21apt-get22:20:062
351421699413,33cyclictest3580397-21apt-get22:20:052
3514216994128,9cyclictest0-21swapper/222:20:012
3514216994118,19cyclictest0-21swapper/222:05:242
351421699411,35cyclictest3556307-21apt-get21:10:062
351421699411,34cyclictest3549716-21apt-get20:50:132
351421699410,36cyclictest3553399-21/usr/sbin/munin21:00:182
3514211994132,6cyclictest3519878-21munin-plugin-st19:25:001
3514208994134,4cyclictest0-21swapper/022:00:000
3514220994022,10cyclictest131rcu_preempt21:35:133
3514220994022,10cyclictest131rcu_preempt21:35:133
351421699401,36cyclictest3608625-21/usr/sbin/munin23:40:172
351421699401,36cyclictest3602013-21/usr/sbin/munin23:20:252
351421699401,36cyclictest3569387-21/usr/sbin/munin21:45:242
351421699401,36cyclictest3567846-21/usr/sbin/munin21:40:262
351421699401,36cyclictest3564029-21/usr/sbin/munin21:30:192
351421699401,36cyclictest3564029-21/usr/sbin/munin21:30:192
351421699401,36cyclictest3547439-21cron20:41:012
351421699401,36cyclictest3517015-21irqstats19:15:182
351421699401,34cyclictest3532357-21df20:00:142
351421699401,33cyclictest3627327-21apt-get00:35:142
351421699401,33cyclictest3627327-21apt-get00:35:132
351421699401,33cyclictest3589387-21apt-get22:45:142
351421699401,33cyclictest3525431-21apt-get19:40:122
351421699401,32cyclictest3599605-21apt-get23:15:112
351421699400,32cyclictest0-21swapper/219:35:112
3514211994034,4cyclictest3582087-21kworker/u8:1+events_unbound22:22:511
3514211994034,4cyclictest3582087-21kworker/u8:1+events_unbound22:22:511
3514211994032,5cyclictest3584039-21idleruntime-cro22:30:001
3514211994032,5cyclictest3584039-21idleruntime-cro22:29:591
3514208994027,10cyclictest121ktimers/020:45:130
3514208994019,16cyclictest0-21swapper/000:00:330
3514220993933,4cyclictest3567553-21kworker/u8:2+events_unbound21:42:473
3514220993931,6cyclictest3513936-21kworker/u8:2+events_unbound19:12:223
3514216993930,4cyclictest0-21swapper/222:40:172
351421699392,34cyclictest3573931-21df22:00:142
351421699392,34cyclictest3531202-21/usr/sbin/munin19:55:232
351421699392,31cyclictest3529042-21fschecks_time19:50:162
351421699391,35cyclictest3612098-21/usr/sbin/munin23:50:182
351421699391,35cyclictest3597042-21/usr/sbin/munin23:05:232
351421699391,35cyclictest3577339-21df_inode22:10:132
351421699391,35cyclictest3565974-21/usr/sbin/munin21:35:232
351421699391,35cyclictest3565974-21/usr/sbin/munin21:35:222
351421699391,33cyclictest3615508-21/usr/sbin/munin00:00:142
351421699391,33cyclictest3610183-21diskstats23:45:152
351421699391,33cyclictest3551720-21/usr/sbin/munin20:55:162
3514211993933,4cyclictest3571549-21kworker/u8:0+events_unbound21:52:461
3514211993930,6cyclictest3522197-21fschecks_time19:30:161
3514211993928,7cyclictest0-21swapper/122:32:521
3514211993928,7cyclictest0-21swapper/122:32:511
3514208993928,6cyclictest0-21swapper/021:05:250
3514220993832,4cyclictest3538963-21kworker/u8:1+events_unbound20:22:293
351421699382,33cyclictest3591201-21df_inode22:50:162
351421699381,33cyclictest3586412-21meminfo22:35:202
351421699380,33cyclictest3594506-21apt-get23:00:142
3514208993830,4cyclictest3532008-21cat20:00:000
3514208993830,4cyclictest0-21swapper/020:30:010
3514208993830,4cyclictest0-21swapper/020:15:250
3514220993731,4cyclictest3604307-21kworker/u8:2+events_unbound23:33:003
3514220993721,10cyclictest3604307-21kworker/u8:2+events_unbound23:29:403
3514220993718,5cyclictest131rcu_preempt00:20:263
351421699373,31cyclictest3583940-21cron22:28:592
351421699373,31cyclictest3583940-21cron22:28:592
3514216993728,5cyclictest3539042-21munin-plugin-st20:20:012
351421699371,33cyclictest3620503-21apt-get00:15:142
351421699371,33cyclictest3548125-21df20:45:142
351421699371,33cyclictest3539955-21rt-features20:20:212
351421699371,31cyclictest3518842-21/usr/sbin/munin19:20:202
3514211993728,5cyclictest0-21swapper/100:20:001
3514211993727,6cyclictest0-21swapper/123:30:011
3514211993727,6cyclictest0-21swapper/121:05:001
3514211993727,6cyclictest0-21swapper/120:30:241
3514211993719,10cyclictest3576673-21kworker/u8:2+events_unbound22:10:141
3514208993728,5cyclictest0-21swapper/022:15:250
3514220993629,4cyclictest0-21swapper/320:50:003
3514220993626,6cyclictest3555825-21unixbench_multi21:05:253
3514220993618,11cyclictest131rcu_preempt21:20:203
3514220993615,6cyclictest131rcu_preempt23:20:273
351421699363,30cyclictest3592906-21diskstats22:55:172
351421699362,29cyclictest3540985-21apt-get20:25:122
351421699361,32cyclictest3622225-21apt-get00:20:132
351421699361,32cyclictest3607339-21/usr/sbin/munin23:35:232
351421699361,32cyclictest3604858-21/usr/sbin/munin23:30:162
351421699361,32cyclictest3585536-21sshd22:32:512
351421699361,32cyclictest3585536-21sshd22:32:512
3514211993628,4cyclictest0-21swapper/100:30:151
3514211993623,6cyclictest3519824-21kworker/u8:1+events_unbound19:36:421
3514211993616,13cyclictest131rcu_preempt00:20:171
3514211993614,11cyclictest0-21swapper/119:25:211
351420899366,6cyclictest11-21ksoftirqd/021:30:130
351420899366,6cyclictest11-21ksoftirqd/021:30:120
3514208993628,4cyclictest3528599-21auditctl19:50:000
3514208993625,6cyclictest0-21swapper/021:00:010
3514220993528,4cyclictest3552890-21cron21:00:013
3514220993520,9cyclictest3614826-21kworker/u8:1+events_unbound00:10:203
3514220993520,5cyclictest131rcu_preempt19:20:233
3514220993517,10cyclictest131rcu_preempt23:55:153
3514211993529,4cyclictest3582087-21kworker/u8:1+events_unbound23:07:591
3514211993527,5cyclictest3624921-21runrttasks00:25:271
3514211993526,6cyclictest0-21swapper/121:40:001
3514211993526,6cyclictest0-21swapper/121:40:001
3514211993526,6cyclictest0-21swapper/119:55:011
3514211993522,8cyclictest131rcu_preempt20:50:211
3514211993517,11cyclictest131rcu_preempt20:10:241
3514211993515,12cyclictest131rcu_preempt21:25:231
3514211993514,13cyclictest131rcu_preempt23:15:011
3514211993514,12cyclictest131rcu_preempt22:00:261
3514208993524,6cyclictest0-21swapper/022:50:260
3514220993423,7cyclictest0-21swapper/320:45:003
3514220993423,4cyclictest131rcu_preempt23:35:233
3514220993420,4cyclictest131rcu_preempt21:55:103
3514220993417,4cyclictest131rcu_preempt19:38:523
3514220993415,11cyclictest0-21swapper/322:17:413
3514220993414,5cyclictest131rcu_preempt21:50:093
3514220993414,11cyclictest3558026-21kworker/u8:3-events_unbound21:16:183
3514220993413,13cyclictest3582087-21kworker/u8:1-rpciod23:05:193
3514211993419,5cyclictest131rcu_preempt23:20:191
3514211993412,5cyclictest131rcu_preempt19:15:021
3514211993411,15cyclictest131rcu_preempt20:35:241
3514208993424,6cyclictest0-21swapper/020:10:260
351422099338,7cyclictest40-21ksoftirqd/322:39:593
3514220993325,5cyclictest3590429-21grep22:45:273
3514220993317,4cyclictest131rcu_preempt23:50:173
3514220993315,9cyclictest131rcu_preempt00:29:593
3514220993314,10cyclictest0-21swapper/319:49:433
3514220993312,11cyclictest131rcu_preempt19:50:243
3514211993325,4cyclictest0-21swapper/121:10:271
3514211993323,6cyclictest0-21swapper/100:10:001
3514211993317,5cyclictest131rcu_preempt23:45:001
3514211993315,10cyclictest3597892-21kworker/u8:0+events_unbound23:18:181
3514211993314,4cyclictest131rcu_preempt21:15:191
3514211993312,5cyclictest131rcu_preempt22:55:121
3514211993312,5cyclictest131rcu_preempt22:41:471
3514211993312,5cyclictest131rcu_preempt21:00:011
3514211993310,12cyclictest24-21ksoftirqd/123:45:241
3514208993318,3cyclictest131rcu_preempt22:45:270
3514208993314,11cyclictest11-21ksoftirqd/020:00:140
351422099329,16cyclictest40-21ksoftirqd/322:20:243
351422099329,16cyclictest40-21ksoftirqd/322:20:243
3514220993225,4cyclictest0-21swapper/321:00:273
3514220993223,6cyclictest3618560-21cron00:10:013
3514220993223,6cyclictest0-21swapper/323:05:003
3514220993222,6cyclictest0-21swapper/320:25:253
3514220993218,4cyclictest3590720-21kworker/u8:2-events_freezable_power_22:51:123
3514220993218,4cyclictest131rcu_preempt00:00:143
3514220993217,5cyclictest131rcu_preempt22:10:213
3514220993212,5cyclictest131rcu_preempt20:32:323
3514220993210,14cyclictest40-21ksoftirqd/323:45:013
3514211993226,4cyclictest3540688-21kworker/u8:0+events_unbound20:42:331
3514211993224,4cyclictest3524958-21kworker/u8:3+events_unbound19:42:261
3514211993224,4cyclictest0-21swapper/119:55:161
3514211993215,5cyclictest131rcu_preempt00:00:181
3514211993215,11cyclictest131rcu_preempt19:50:001
3514211993214,10cyclictest131rcu_preempt00:10:271
3514211993213,5cyclictest131rcu_preempt20:25:251
351420899325,13cyclictest11-21ksoftirqd/021:45:010
3514208993223,6cyclictest0-21swapper/021:05:010
3514208993223,4cyclictest3621559-21grep00:15:260
3514208993222,6cyclictest0-21swapper/000:25:270
3514208993220,8cyclictest3612960-21grep23:50:260
351420899321,25cyclictest0-21swapper/019:14:400
351422099315,7cyclictest40-21ksoftirqd/321:10:253
3514220993123,5cyclictest381rcuc/319:30:093
3514220993121,8cyclictest391ktimers/321:45:253
3514220993121,7cyclictest381rcuc/300:38:393
3514220993121,7cyclictest381rcuc/300:38:393
3514220993119,8cyclictest391ktimers/319:55:243
3514220993119,8cyclictest391ktimers/300:15:233
3514220993119,4cyclictest131rcu_preempt19:25:013
3514220993118,8cyclictest391ktimers/323:16:133
3514220993117,3cyclictest131rcu_preempt20:50:163
3514220993116,5cyclictest131rcu_preempt19:40:223
3514220993115,5cyclictest131rcu_preempt23:10:123
3514220993111,4cyclictest381rcuc/322:40:233
3514220993110,10cyclictest3535237-21users20:05:273
3514211993119,5cyclictest131rcu_preempt21:20:201
3514211993113,9cyclictest131rcu_preempt22:35:251
3514211993113,5cyclictest131rcu_preempt22:50:221
3514211993113,11cyclictest131rcu_preempt21:45:191
3514211993112,12cyclictest24-21ksoftirqd/123:50:241
351420899317,8cyclictest11-21ksoftirqd/021:37:430
351420899317,8cyclictest11-21ksoftirqd/021:37:430
351420899314,9cyclictest3587481-21latency_hist22:40:010
3514208993120,8cyclictest121ktimers/019:22:360
3514208993115,4cyclictest131rcu_preempt21:25:150
351422099308,11cyclictest131rcu_preempt23:45:173
3514220993023,5cyclictest381rcuc/300:30:483
3514220993013,5cyclictest131rcu_preempt21:30:113
3514220993013,5cyclictest131rcu_preempt21:30:103
3514220993012,5cyclictest131rcu_preempt22:00:243
3514220993011,4cyclictest131rcu_preempt22:55:173
351421199304,15cyclictest3537763-21grep20:15:171
351421199301,14cyclictest0-21swapper/123:32:251
3514211993011,11cyclictest131rcu_preempt21:40:161
351420899307,8cyclictest3626459-21ls00:30:230
351420899304,7cyclictest11-21ksoftirqd/019:15:040
351420899302,6cyclictest3582818-21basename22:25:150
351420899302,6cyclictest3582818-21basename22:25:150
3514208993020,6cyclictest0-21swapper/023:30:260
3514208993020,6cyclictest0-21swapper/023:25:250
3514208993020,6cyclictest0-21swapper/021:45:260
3514208993011,9cyclictest131rcu_preempt23:55:210
3514211992921,5cyclictest0-21swapper/123:55:261
3514211992913,5cyclictest131rcu_preempt20:00:211
3514211992912,10cyclictest131rcu_preempt20:45:221
3514211992910,11cyclictest131rcu_preempt20:20:181
351420899295,13cyclictest121ktimers/022:30:240
351420899295,13cyclictest121ktimers/022:30:240
351420899294,6cyclictest11-21ksoftirqd/022:55:230
351420899293,8cyclictest11-21ksoftirqd/023:15:250
351420899292,7cyclictest11-21ksoftirqd/020:25:010
351420899292,6cyclictest11-21ksoftirqd/022:10:250
351420899292,5cyclictest3597224-21sed23:05:230
3514208992921,6cyclictest121ktimers/021:10:010
3514208992920,6cyclictest3608542-21grep23:40:160
3514208992915,4cyclictest131rcu_preempt23:24:510
351420899291,19cyclictest11-21ksoftirqd/020:39:120
3514208992910,5cyclictest131rcu_preempt23:00:240
351421199288,10cyclictest131rcu_preempt21:30:141
351421199288,10cyclictest131rcu_preempt21:30:141
3514211992813,4cyclictest131rcu_preempt21:55:171
351420899287,6cyclictest11-21ksoftirqd/023:45:170
351420899286,6cyclictest11-21ksoftirqd/022:10:010
351420899284,5cyclictest11-21ksoftirqd/019:45:020
351420899283,6cyclictest11-21ksoftirqd/019:25:010
3514208992818,7cyclictest121ktimers/021:15:130
3514208992818,7cyclictest121ktimers/000:10:240
3514208992811,8cyclictest131rcu_preempt00:23:360
3514208992810,9cyclictest131rcu_preempt00:05:210
351420899273,6cyclictest11-21ksoftirqd/021:20:250
351420899272,5cyclictest151rcuc/023:36:160
3514208992719,5cyclictest3550761-21sed20:50:260
351420899271,7cyclictest11-21ksoftirqd/020:05:020
3514208992713,3cyclictest131rcu_preempt19:54:010
351420899271,10cyclictest11-21ksoftirqd/022:20:230
351420899271,10cyclictest11-21ksoftirqd/022:20:230
351420899270,3cyclictest0-21swapper/020:33:320
351420899254,4cyclictest151rcuc/021:50:150
351420899252,6cyclictest11-21ksoftirqd/000:35:240
351420899252,6cyclictest11-21ksoftirqd/000:35:230
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional