You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-05-26 - 09:57

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #b, slot #5

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  Phytec
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.

Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the highest latencies:
System rackbslot5s.osadl.org (updated Tue May 26, 2026 00:44:50)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
3417163995142,5cyclictest3417155-21cyclictest22:27:530
3417172994939,7cyclictest3487566-21grep22:30:252
3417178994737,6cyclictest3452386-21grep20:50:173
3417178994737,6cyclictest3452386-21grep20:50:163
3417168994638,5cyclictest3474374-21sh21:55:011
3417163994535,7cyclictest3474380-21debian-sa121:55:010
3417178994437,4cyclictest3441768-21munin-plugin-st20:20:013
3417172994427,7cyclictest131rcu_preempt21:40:112
3417178994335,5cyclictest34967972sleep323:00:133
3417178994211,14cyclictest131rcu_preempt22:20:003
3417172994135,4cyclictest3528354-21kworker/u8:3+events_unbound00:38:042
3417168994133,4cyclictest0-21swapper/119:15:011
3417163994132,5cyclictest3489720-21sh22:40:000
3417178994034,4cyclictest3525749-21kworker/u8:1+events_unbound00:33:043
3417178994034,4cyclictest3525749-21kworker/u8:1+events_unbound00:33:033
341717299401,13cyclictest32-21ksoftirqd/220:30:122
3417168994032,4cyclictest0-21swapper/100:05:011
3417178993932,4cyclictest3509067-21fschecks_count23:35:153
3417178993932,3cyclictest0-21swapper/300:15:003
3417178993931,6cyclictest3469101-21kworker/u8:2+events_unbound21:47:493
3417178993916,6cyclictest131rcu_preempt22:05:103
3417163993925,11cyclictest121ktimers/000:25:140
3417178993729,4cyclictest0-21swapper/323:25:163
3417178993729,4cyclictest0-21swapper/320:20:253
3417178993728,4cyclictest0-21swapper/300:20:163
3417178993723,10cyclictest391ktimers/323:50:113
3417172993729,4cyclictest3437884-21unixbench_multi20:05:262
3417172993728,7cyclictest3496471-21kworker/u8:0+events_unbound23:12:582
3417163993729,4cyclictest0-21swapper/020:27:410
3417178993630,4cyclictest3489602-21kworker/u8:2+events_unbound23:18:413
3417172993630,4cyclictest3390686-21kworker/u8:3+events_unbound20:12:402
3417172993629,4cyclictest3448568-21cron20:40:012
3417168993631,3cyclictest3456786-21kworker/u8:3+events_unbound21:22:461
3417168993626,6cyclictest0-21swapper/119:55:001
3417163993628,4cyclictest0-21swapper/020:45:170
3417163993615,3cyclictest131rcu_preempt22:15:120
3417178993529,4cyclictest3390686-21kworker/u8:3+events_unbound19:47:373
3417178993518,6cyclictest3424557-21kworker/u8:2+events_unbound19:41:003
3417178993517,5cyclictest3441736-21kworker/u8:2+events_unbound20:37:143
3417168993528,4cyclictest3531075-21latency_hist00:40:001
3417168993527,4cyclictest0-21swapper/121:35:001
3417168993522,9cyclictest231ktimers/123:35:101
3417163993525,6cyclictest0-21swapper/020:15:270
3417178993427,4cyclictest3469268-21sendmail21:39:593
3417172993428,4cyclictest3486309-21kworker/u8:1+events_unbound22:52:562
3417172993428,4cyclictest3479401-21kworker/u8:3+events_unbound22:27:542
3417172993425,5cyclictest3507004-21munin-plugin-st23:29:592
3417168993426,5cyclictest3453683-21cron20:55:001
3417168993426,5cyclictest3453683-21cron20:55:001
3417168993426,5cyclictest3448568-21cron20:40:001
3417168993426,4cyclictest0-21swapper/123:45:261
3417163993428,4cyclictest3489602-21kworker/u8:2+events_unbound22:42:550
3417163993423,7cyclictest0-21swapper/000:15:000
3417178993325,4cyclictest0-21swapper/319:15:013
3417178993324,5cyclictest3461952-21grep21:15:283
3417172993326,4cyclictest0-21swapper/200:19:592
3417172993323,7cyclictest3458849-21sort21:10:012
3417172993323,6cyclictest0-21swapper/220:15:272
3417172993322,7cyclictest3461965-21grep21:15:292
3417172993320,4cyclictest3469101-21kworker/u8:2+events_unbound21:38:462
3417163993325,4cyclictest0-21swapper/021:40:000
3417178993224,3cyclictest0-21swapper/300:35:253
3417178993221,7cyclictest3423734-21wc19:25:213
3417178993220,8cyclictest3475669-21grep21:55:273
341717899321,9cyclictest40-21ksoftirqd/300:25:133
3417178993211,12cyclictest40-21ksoftirqd/321:10:023
3417172993224,4cyclictest0-21swapper/219:40:002
3417172993223,5cyclictest0-21swapper/219:15:272
3417172993223,4cyclictest0-21swapper/221:25:272
3417172993223,4cyclictest0-21swapper/221:25:272
3417172993222,6cyclictest0-21swapper/222:55:152
3417172993222,6cyclictest0-21swapper/222:20:262
3417172993222,6cyclictest0-21swapper/221:55:272
3417172993222,5cyclictest0-21swapper/222:45:272
3417172993222,5cyclictest0-21swapper/222:45:272
3417168993224,4cyclictest0-21swapper/119:35:001
3417168993224,4cyclictest0-21swapper/119:34:591
3417168993223,5cyclictest0-21swapper/121:47:481
3417168993219,9cyclictest231ktimers/120:05:131
3417163993225,4cyclictest3465862-21munin-plugin-st21:30:000
3417163993225,4cyclictest3465862-21munin-plugin-st21:30:000
3417178993123,4cyclictest0-21swapper/320:00:163
3417178993120,8cyclictest391ktimers/323:55:123
3417178993115,5cyclictest3508648-21kworker/u8:3+events_unbound23:47:433
3417172993125,3cyclictest0-21swapper/220:45:002
3417172993124,3cyclictest0-21swapper/220:52:442
3417172993124,3cyclictest0-21swapper/220:52:442
3417172993121,6cyclictest0-21swapper/220:59:592
3417168993123,4cyclictest0-21swapper/120:30:161
3417168993122,6cyclictest3482425-21unixbench_multi22:15:241
3417163993125,4cyclictest3479401-21kworker/u8:3+events_unbound22:57:560
3417163993124,5cyclictest3431527-21cron19:50:000
3417163993119,9cyclictest121ktimers/020:40:120
3417163993119,7cyclictest3467559-21sh21:34:590
3417178993023,3cyclictest0-21swapper/321:00:003
3417178993021,4cyclictest3520857-21munin-plugin-st00:10:003
3417178993021,4cyclictest0-21swapper/320:25:273
3417178993020,6cyclictest3421291-21cron19:20:013
3417178993018,3cyclictest131rcu_preempt00:20:013
341717299307,4cyclictest131rcu_preempt20:00:132
3417172993024,4cyclictest3458618-21kworker/u8:0+events_unbound21:12:422
3417172993024,4cyclictest3422831-21kworker/u8:0+events_unbound19:33:422
3417172993024,4cyclictest3422831-21kworker/u8:0+events_unbound19:33:422
3417172993023,5cyclictest3496471-21kworker/u8:0+events_unbound23:17:582
3417172993023,3cyclictest0-21swapper/223:35:002
3417172993020,7cyclictest3521212-21fschecks_count00:10:142
3417172993020,5cyclictest0-21swapper/200:30:152
3417172993020,5cyclictest0-21swapper/200:30:152
3417172993019,8cyclictest311ktimers/222:35:112
3417163993024,3cyclictest0-21swapper/022:45:270
3417163993024,3cyclictest0-21swapper/022:45:260
3417163993020,6cyclictest0-21swapper/023:30:250
341717899299,11cyclictest40-21ksoftirqd/320:05:203
341717899297,5cyclictest131rcu_preempt21:25:273
341717899297,5cyclictest131rcu_preempt21:25:273
341717899297,12cyclictest40-21ksoftirqd/319:20:223
3417178992922,5cyclictest3390686-21kworker/u8:3+events_unbound19:52:393
3417178992921,4cyclictest0-21swapper/319:35:143
3417178992919,7cyclictest0-21swapper/322:25:263
3417178992919,6cyclictest0-21swapper/323:20:253
3417172992923,3cyclictest3481209-21munin-plugin-st22:15:012
3417172992922,4cyclictest0-21swapper/219:55:252
3417172992921,5cyclictest0-21swapper/200:10:002
3417172992921,4cyclictest0-21swapper/223:55:262
3417172992920,6cyclictest0-21swapper/221:20:262
3417168992922,5cyclictest3441736-21kworker/u8:2+events_unbound20:57:461
3417168992918,7cyclictest1-21systemd22:57:551
3417163992922,4cyclictest0-21swapper/021:15:290
3417163992922,3cyclictest0-21swapper/023:55:260
3417163992922,3cyclictest0-21swapper/021:50:010
3417163992921,4cyclictest0-21swapper/019:45:000
3417163992921,4cyclictest0-21swapper/000:15:260
3417163992918,6cyclictest0-21swapper/023:50:200
3417163992911,5cyclictest0-21swapper/000:30:150
3417163992911,5cyclictest0-21swapper/000:30:140
341717899289,11cyclictest40-21ksoftirqd/319:35:013
341717899289,11cyclictest40-21ksoftirqd/319:35:013
341717899289,10cyclictest0-21swapper/321:43:233
3417172992820,6cyclictest3456786-21kworker/u8:3+events_unbound21:32:482
3417172992814,7cyclictest131rcu_preempt00:05:012
3417168992822,4cyclictest3503200-21kworker/u8:3+events_unbound23:22:581
3417168992820,4cyclictest0-21swapper/100:05:251
3417168992819,5cyclictest0-21swapper/121:25:271
3417168992819,5cyclictest0-21swapper/121:25:261
3417168992818,7cyclictest0-21swapper/120:30:011
3417163992821,3cyclictest0-21swapper/023:30:000
3417163992820,5cyclictest0-21swapper/022:20:260
341716399280,26cyclictest0-21swapper/023:45:130
341717899277,11cyclictest40-21ksoftirqd/322:54:593
341717899273,13cyclictest0-21swapper/300:01:263
3417178992718,6cyclictest391ktimers/321:20:133
3417178992718,4cyclictest0-21swapper/322:25:013
3417178992716,7cyclictest3499958-21sh23:10:013
3417178992712,9cyclictest204-21dbus-daemon21:02:453
3417178992712,7cyclictest40-21ksoftirqd/322:40:003
3417172992721,3cyclictest0-21swapper/221:00:162
3417172992720,5cyclictest3390686-21kworker/u8:3+events_unbound19:49:422
3417172992720,4cyclictest0-21swapper/223:20:252
3417172992717,6cyclictest0-21swapper/223:35:242
3417168992721,4cyclictest3496471-21kworker/u8:0+events_unbound23:02:561
3417168992720,4cyclictest3524246-21cron00:20:001
3417168992718,6cyclictest0-21swapper/123:20:001
3417168992717,7cyclictest0-21swapper/122:30:001
3417163992721,3cyclictest0-21swapper/023:00:250
341716399271,22cyclictest0-21swapper/000:05:040
341717899268,5cyclictest131rcu_preempt20:00:023
341717899268,11cyclictest40-21ksoftirqd/321:50:263
341717899267,4cyclictest131rcu_preempt23:30:113
341717899263,5cyclictest381rcuc/322:11:053
3417178992620,4cyclictest3476476-21fschecks_count22:00:153
3417178992619,5cyclictest3499612-21kworker/u8:1+events_unbound23:10:223
3417178992619,5cyclictest3486309-21kworker/u8:1+events_unbound22:45:363
3417178992619,5cyclictest3486309-21kworker/u8:1+events_unbound22:45:363
3417178992618,4cyclictest0-21swapper/321:30:263
3417178992618,4cyclictest0-21swapper/321:10:253
341717899261,14cyclictest0-21swapper/322:40:153
341717899261,13cyclictest40-21ksoftirqd/320:10:263
341717299262,3cyclictest3515045-21grep23:50:242
3417172992620,4cyclictest2675980-21kworker/u8:2+events_unbound19:12:262
3417172992620,3cyclictest0-21swapper/219:20:242
3417172992619,5cyclictest3523914-21kworker/u8:0+events_unbound00:25:272
3417172992619,5cyclictest3481139-21kworker/u8:2+events_unbound22:15:232
3417172992616,6cyclictest0-21swapper/219:45:012
341717299261,12cyclictest0-21swapper/223:00:122
3417168992620,3cyclictest0-21swapper/123:55:161
3417168992619,4cyclictest3441756-21apt20:20:011
3417168992619,4cyclictest0-21swapper/119:40:241
3417168992617,6cyclictest0-21swapper/121:10:001
3417163992620,3cyclictest0-21swapper/020:55:250
3417163992619,4cyclictest13550irq/42-30be0000.ethernet19:20:010
3417163992618,5cyclictest0-21swapper/020:15:010
3417163992618,4cyclictest0-21swapper/023:05:250
3417163992618,4cyclictest0-21swapper/019:50:190
3417163992617,3cyclictest0-21swapper/021:20:260
3417163992616,7cyclictest3524765-21cat00:20:170
341716399261,5cyclictest3435181-21apt-get20:00:130
3417163992614,9cyclictest3428124-21run-parts19:40:000
341717899257,3cyclictest131rcu_preempt23:40:213
341717899257,3cyclictest131rcu_preempt23:40:203
3417178992519,3cyclictest0-21swapper/320:40:133
3417178992518,4cyclictest3446419-21tail20:30:253
3417178992516,6cyclictest3496471-21kworker/u8:0+events_unbound22:59:313
341717899251,13cyclictest0-21swapper/322:33:593
3417178992510,6cyclictest40-21ksoftirqd/320:50:013
341717299257,10cyclictest32-21ksoftirqd/223:05:222
3417172992518,4cyclictest0-21swapper/221:45:242
3417172992518,4cyclictest0-21swapper/219:25:252
3417172992517,5cyclictest0-21swapper/222:45:002
3417172992515,7cyclictest3444694-21unixbench_multi20:25:272
3417168992519,3cyclictest0-21swapper/122:30:221
3417168992517,6cyclictest3390686-21kworker/u8:3+events_unbound20:12:421
3417168992517,5cyclictest145-21jbd2/mmcblk1p2-823:10:211
3417168992517,4cyclictest0-21swapper/121:00:261
3417163992519,4cyclictest3489602-21kworker/u8:2-ext4-rsv-conversion23:15:010
3417163992519,4cyclictest0-21swapper/000:35:250
3417163992518,4cyclictest13550irq/42-30be0000.ethernet22:30:180
3417163992517,5cyclictest0-21swapper/021:55:220
3417163992516,6cyclictest0-21swapper/019:55:250
341717299246,7cyclictest3472913-21cpu21:50:132
3417172992418,3cyclictest3433292-21latency_hist19:55:012
3417172992418,3cyclictest0-21swapper/223:40:212
3417172992418,3cyclictest0-21swapper/223:40:212
3417172992417,4cyclictest0-21swapper/222:00:262
3417172992413,4cyclictest131rcu_preempt22:08:472
341717299240,17cyclictest3525015-21sed00:20:202
341716899246,7cyclictest131rcu_preempt21:15:131
3417168992418,3cyclictest0-21swapper/119:45:201
3417168992418,3cyclictest0-21swapper/119:20:221
3417168992417,3cyclictest0-21swapper/121:55:261
3417168992416,5cyclictest3521627-21ntpq00:10:191
3417168992416,5cyclictest0-21swapper/100:20:261
3417168992414,7cyclictest0-21swapper/122:45:241
3417168992414,7cyclictest0-21swapper/122:45:231
3417168992413,8cyclictest0-21swapper/120:05:011
3417168992413,7cyclictest0-21swapper/122:00:261
3417168992411,9cyclictest3421310-21tr19:20:011
341716399249,13cyclictest34233562sleep019:25:170
3417163992420,2cyclictest13550irq/42-30be0000.ethernet22:05:250
3417163992417,5cyclictest3504831-21unixbench_multi23:20:250
3417163992417,3cyclictest0-21swapper/020:40:010
341716399241,19cyclictest0-21swapper/021:09:440
341716399241,14cyclictest0-21swapper/020:08:100
341716399240,3cyclictest0-21swapper/021:10:310
3417172992317,4cyclictest3441736-21kworker/u8:2+events_unbound20:45:072
3417172992310,7cyclictest131rcu_preempt23:50:002
3417168992317,3cyclictest0-21swapper/123:25:231
3417168992317,3cyclictest0-21swapper/120:40:191
3417168992317,3cyclictest0-21swapper/100:25:231
3417168992314,6cyclictest0-21swapper/123:40:161
3417168992314,6cyclictest0-21swapper/123:40:161
3417168992314,6cyclictest0-21swapper/119:35:231
341716399232,19cyclictest0-21swapper/021:00:250
3417163992316,3cyclictest0-21swapper/022:00:590
3417163992313,7cyclictest3518459-21grep00:00:270
3417163992313,7cyclictest3443072-21grep20:20:250
341716399231,18cyclictest0-21swapper/020:51:560
341716399231,18cyclictest0-21swapper/020:51:550
341716399230,19cyclictest0-21swapper/023:41:510
341716399230,19cyclictest0-21swapper/023:41:510
341716399230,19cyclictest0-21swapper/023:14:540
3417168992216,3cyclictest0-21swapper/123:30:251
3417168992216,3cyclictest0-21swapper/120:45:211
3417168992216,3cyclictest0-21swapper/120:20:251
3417168992215,4cyclictest3514586-21ntpq23:50:201
3417168992215,4cyclictest0-21swapper/122:50:151
3417168992215,4cyclictest0-21swapper/122:10:231
3417168992215,4cyclictest0-21swapper/119:25:171
3417168992214,5cyclictest0-21swapper/120:00:011
3417168992211,8cyclictest3490539-21cat22:40:211
3417163992217,3cyclictest13850irq/36-mmc119:35:000
3417163992217,3cyclictest13850irq/36-mmc119:35:000
3417163992215,4cyclictest3510409-21sendmail23:40:000
3417163992212,7cyclictest3480322-21awk22:10:220
3417163992212,7cyclictest3469935-21cat21:40:180
341716399221,19cyclictest0-21swapper/019:20:170
3417163992210,8cyclictest204-21dbus-daemon19:12:300
3417168992115,3cyclictest0-21swapper/100:30:221
3417168992115,3cyclictest0-21swapper/100:30:221
3417168992112,4cyclictest0-21swapper/121:35:161
341716399211,16cyclictest0-21swapper/022:50:590
3417168992014,3cyclictest0-21swapper/122:05:231
3417168992012,5cyclictest231ktimers/121:40:181
3417168992011,6cyclictest3489719-21sh22:40:001
3417168992010,6cyclictest0-21swapper/121:10:251
3417168991812,4cyclictest231ktimers/123:05:251
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional