You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-08-27 - 09:50

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #b, slot #5

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  Phytec
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.

Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the highest latencies:
System rackbslot5s.osadl.org (updated Thu Aug 27, 2026 00:44:48)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
3588473996135,23cyclictest3680208-21unixbench_multi23:30:271
3588482995124,8cyclictest131rcu_preempt20:30:113
3588473994812,10cyclictest231ktimers/121:25:131
3588473994718,26cyclictest231ktimers/121:15:131
3588473994624,19cyclictest3692625-21kthreadd00:10:001
3588473994616,3cyclictest0-21swapper/122:55:241
3588469994632,11cyclictest121ktimers/020:45:110
3588482994530,6cyclictest3683721-21kworker/u8:1+events_unbound23:41:223
3588473994516,25cyclictest0-21swapper/123:50:261
3588473994510,7cyclictest3631596-21grep21:10:231
3588469994533,8cyclictest3616299-21grep20:25:270
3588482994437,5cyclictest3593821-21kworker/u8:1+events_unbound19:25:303
3588473994434,7cyclictest3621375-21grep20:40:251
3588473994431,10cyclictest231ktimers/123:00:121
3588473994423,18cyclictest3697496-21grep00:20:271
358847399442,12cyclictest3688733-21unixbench_multi23:55:251
3588473994415,25cyclictest0-21swapper/120:05:001
3588469994437,4cyclictest3614613-21unixbench_singl20:20:270
3588473994332,8cyclictest3661487-21sh22:40:001
3588473994316,23cyclictest0-21swapper/122:30:261
3588473994316,23cyclictest0-21swapper/122:30:251
358847399431,13cyclictest3598177-21cut19:35:161
3588469994335,5cyclictest36030922sleep019:50:120
3588469994335,5cyclictest36030922sleep019:50:110
3588469994334,5cyclictest3661523-21idleruntime-cro22:40:010
3588473994235,4cyclictest3685374-21unixbench_singl23:45:271
3588473994216,4cyclictest0-21swapper/120:15:231
358847399421,15cyclictest3611387-21auditctl20:15:021
358847399421,11cyclictest3604556-21cron19:55:011
358847399421,11cyclictest3604556-21cron19:55:001
3588469994234,4cyclictest3657881-21latency_hist22:30:000
3588482994130,8cyclictest3699673-21cron00:30:003
358847399412,11cyclictest3645705-21cron21:55:001
358847399411,8cyclictest3683625-21tail23:40:251
3588473994112,5cyclictest0-21swapper/120:00:001
3588469994133,6cyclictest121ktimers/022:40:100
3588469994130,9cyclictest121ktimers/019:25:130
3588482994034,4cyclictest3631801-21kworker/u8:0+events_unbound21:20:503
3588477994032,5cyclictest3640594-21cron21:40:002
358847399401,13cyclictest3639670-21grep21:35:201
3588482993930,4cyclictest0-21swapper/321:00:453
3588477993932,5cyclictest3675227-21kworker/u8:3+events_unbound23:21:182
3588477993931,4cyclictest0-21swapper/200:40:002
3588473993913,3cyclictest3646101-21fschecks_count21:55:161
3588469993932,4cyclictest3626966-21sendmail21:00:000
3588469993927,6cyclictest0-21swapper/022:05:270
3588477993828,5cyclictest0-21swapper/222:45:232
358847399381,12cyclictest3677058-21cron23:25:001
358847399381,11cyclictest3629523-21ps21:05:241
3588473993810,6cyclictest3666339-21/usr/sbin/munin22:50:281
358846999389,10cyclictest3703091-21munin-run00:40:000
358847799378,5cyclictest131rcu_preempt00:00:122
358847799378,5cyclictest131rcu_preempt00:00:122
3588477993717,5cyclictest3618160-21kworker/u8:2+events_unbound20:32:082
358847399372,8cyclictest3662967-21tail22:40:221
3588473993723,9cyclictest3597059-21grep19:30:271
3588469993728,6cyclictest3674878-21grep23:15:260
3588482993630,4cyclictest3599816-21kworker/u8:0+events_unbound19:55:353
3588482993622,5cyclictest3640428-21kworker/u8:1+events_unbound21:54:213
3588482993616,6cyclictest3599816-21kworker/u8:0+events_unbound19:46:023
3588482993616,6cyclictest3599816-21kworker/u8:0+events_unbound19:46:023
3588477993625,8cyclictest3635084-21grep21:20:272
3588477993618,13cyclictest311ktimers/220:55:142
3588473993624,8cyclictest3614539-21grep20:20:261
358846999369,6cyclictest11-21ksoftirqd/023:10:140
358848299359,13cyclictest131rcu_preempt22:55:153
3588482993518,6cyclictest3640428-21kworker/u8:1+events_unbound21:43:363
3588482993518,6cyclictest3640428-21kworker/u8:1+events_unbound21:43:353
3588477993526,6cyclictest0-21swapper/223:45:002
3588473993527,4cyclictest0-21swapper/119:10:241
3588473993523,8cyclictest0-21swapper/121:30:301
358846999359,7cyclictest11-21ksoftirqd/022:00:220
3588469993525,6cyclictest0-21swapper/023:50:270
3588482993427,3cyclictest0-21swapper/300:09:593
3588482993425,6cyclictest3697500-21grep00:20:283
3588482993425,6cyclictest3603234-21cut19:50:163
3588482993425,6cyclictest3603234-21cut19:50:153
3588482993418,5cyclictest3664754-21kworker/u8:1+events_unbound23:06:583
3588482993418,12cyclictest391ktimers/321:35:113
3588482993415,6cyclictest3685436-21kworker/u8:0+events_unbound00:04:033
3588482993415,6cyclictest3685436-21kworker/u8:0+events_unbound00:04:033
3588477993428,4cyclictest3654465-21munin-plugin-st22:20:012
3588477993426,4cyclictest0-21swapper/221:10:002
3588477993424,6cyclictest0-21swapper/200:09:592
3588473993424,6cyclictest3624819-21grep20:50:251
3588473993424,5cyclictest3626588-21kworker/u8:1+events_unbound21:00:461
3588473993423,7cyclictest3695775-21grep00:15:231
358846999344,14cyclictest3632379-21cpuspeed21:15:140
3588469993427,3cyclictest0-21swapper/019:10:240
3588482993326,4cyclictest0-21swapper/322:35:383
3588482993324,6cyclictest3676627-21grep23:20:263
3588482993318,5cyclictest3597257-21kworker/u8:2+events_unbound19:33:273
358848299331,17cyclictest0-21swapper/319:40:133
358848299330,6cyclictest0-21swapper/323:55:133
3588477993323,6cyclictest0-21swapper/219:55:262
3588477993322,5cyclictest3599816-21kworker/u8:0+events_unbound19:44:542
3588477993320,9cyclictest311ktimers/219:10:112
3588473993325,4cyclictest0-21swapper/121:20:271
3588473993321,8cyclictest3675342-21sh23:20:011
358846999334,10cyclictest3635545-21cat21:25:000
358848299324,5cyclictest40-21ksoftirqd/322:00:013
3588482993225,4cyclictest0-21swapper/320:05:273
3588482993223,5cyclictest0-21swapper/322:05:273
3588482993216,5cyclictest3630085-21kworker/u8:1+events_unbound21:25:473
358848299320,15cyclictest0-21swapper/320:55:133
3588477993224,5cyclictest0-21swapper/200:35:012
3588477993223,6cyclictest0-21swapper/220:45:012
3588477993213,4cyclictest3654180-21kworker/u8:2+events_unbound22:34:582
3588477993213,4cyclictest3654180-21kworker/u8:2+events_unbound22:34:582
3588473993225,3cyclictest0-21swapper/122:15:001
3588473993216,12cyclictest231ktimers/100:10:121
358846999328,6cyclictest11-21ksoftirqd/019:55:250
358846999327,6cyclictest11-21ksoftirqd/019:50:010
358846999327,6cyclictest11-21ksoftirqd/019:50:010
358846999325,9cyclictest3620310-21date20:40:000
3588469993224,4cyclictest0-21swapper/021:35:240
3588482993125,4cyclictest3699902-21kworker/u8:1+events_unbound00:34:003
3588482993124,5cyclictest3640428-21kworker/u8:1+events_unbound22:15:123
3588482993124,4cyclictest0-21swapper/322:20:273
3588482993123,4cyclictest0-21swapper/323:35:013
3588482993122,7cyclictest3619885-21kworker/u8:1+events_unbound20:45:003
3588477993123,5cyclictest0-21swapper/223:05:002
3588477993122,5cyclictest0-21swapper/221:20:002
3588473993122,5cyclictest0-21swapper/121:40:551
3588473993122,5cyclictest0-21swapper/121:40:551
3588473993122,4cyclictest0-21swapper/119:20:241
358846999315,13cyclictest3651402-21entropy22:10:160
358846999315,10cyclictest3641327-21missed_timers21:40:210
358846999315,10cyclictest3641327-21missed_timers21:40:210
3588469993122,5cyclictest0-21swapper/022:25:000
3588469993120,7cyclictest3696247-21latency_hist00:20:020
3588469993119,8cyclictest3613317-21tr20:20:010
358846999311,3cyclictest0-21swapper/022:30:130
358846999311,3cyclictest0-21swapper/022:30:120
358846999311,11cyclictest3591026-21awk19:15:130
358848299308,13cyclictest40-21ksoftirqd/320:55:023
358848299305,15cyclictest3593532-21timerandwakeup19:20:223
3588482993023,4cyclictest3588795-21fschecks_count19:10:153
3588482993022,6cyclictest3640428-21kworker/u8:1+events_unbound21:47:423
3588477993023,5cyclictest3640428-21kworker/u8:1+events_unbound21:54:202
3588477993023,3cyclictest0-21swapper/219:50:252
3588477993023,3cyclictest0-21swapper/219:50:252
3588477993022,5cyclictest0-21swapper/223:50:162
3588477993022,4cyclictest0-21swapper/223:10:012
3588477993022,4cyclictest0-21swapper/220:35:162
3588477993022,4cyclictest0-21swapper/220:05:172
3588477993022,4cyclictest0-21swapper/219:35:012
3588477993018,6cyclictest3599816-21kworker/u8:0+events_unbound19:49:022
3588477993018,6cyclictest3599816-21kworker/u8:0+events_unbound19:49:012
3588477993012,12cyclictest131rcu_preempt20:10:122
358846999305,8cyclictest3638899-21latency_hist21:35:010
3588469993023,4cyclictest0-21swapper/000:25:000
3588469993013,3cyclictest11-21ksoftirqd/020:35:010
358846999300,28cyclictest0-21swapper/022:50:140
358848299293,8cyclictest40-21ksoftirqd/323:15:263
3588482992923,4cyclictest3630085-21kworker/u8:1+events_unbound21:15:503
3588482992922,4cyclictest0-21swapper/320:35:253
3588482992921,5cyclictest3637424-21/usr/sbin/munin21:30:193
3588477992922,5cyclictest3657423-21unixbench_multi22:25:242
3588477992922,4cyclictest0-21swapper/220:50:162
3588477992922,3cyclictest0-21swapper/223:10:152
3588477992921,4cyclictest0-21swapper/221:55:152
3588473992921,4cyclictest0-21swapper/100:40:011
3588473992919,5cyclictest0-21swapper/123:26:181
3588473992919,5cyclictest0-21swapper/120:05:381
3588473992918,7cyclictest3699677-21sh00:30:001
358846999299,17cyclictest0-21swapper/000:04:050
358846999299,17cyclictest0-21swapper/000:04:050
358846999298,7cyclictest0-21swapper/021:25:200
358846999294,22cyclictest3647028-21sshd21:55:270
3588469992923,3cyclictest0-21swapper/023:30:270
3588469992921,4cyclictest0-21swapper/019:30:280
3588469992916,10cyclictest0-21swapper/021:10:110
3588469992914,11cyclictest438-21cron23:25:010
3588469992913,2cyclictest0-21swapper/023:00:250
3588482992822,4cyclictest3678986-21munin-run23:30:013
3588482992821,3cyclictest0-21swapper/322:45:003
358848299281,12cyclictest0-21swapper/322:28:083
3588482992810,4cyclictest381rcuc/322:00:143
3588477992821,4cyclictest0-21swapper/222:05:272
3588473992821,3cyclictest0-21swapper/120:45:141
3588473992818,7cyclictest0-21swapper/122:30:011
3588473992817,8cyclictest3654060-21sshd22:15:271
3588469992822,3cyclictest0-21swapper/020:05:270
3588469992813,12cyclictest0-21swapper/000:25:130
358846999281,24cyclictest0-21swapper/022:55:160
358848299279,3cyclictest131rcu_preempt23:15:003
3588482992721,4cyclictest3685436-21kworker/u8:0+events_unbound23:47:273
3588482992721,4cyclictest3657666-21kworker/u8:0+events_unbound22:31:083
3588482992721,4cyclictest3657666-21kworker/u8:0+events_unbound22:31:073
3588482992718,6cyclictest3631591-21grep21:10:233
358848299271,7cyclictest3629130-21cut21:05:173
358848299271,12cyclictest0-21swapper/320:47:213
358848299270,6cyclictest0-21swapper/320:25:113
358847799278,4cyclictest131rcu_preempt21:25:142
3588477992721,4cyclictest3599816-21kworker/u8:0+events_unbound20:28:422
3588477992720,4cyclictest0-21swapper/220:45:242
3588477992720,4cyclictest0-21swapper/219:35:252
3588477992720,3cyclictest0-21swapper/221:00:142
3588477992720,3cyclictest0-21swapper/219:25:002
3588477992719,5cyclictest0-21swapper/222:55:242
3588477992719,4cyclictest0-21swapper/200:15:002
3588477992712,7cyclictest131rcu_preempt21:50:012
3588477992712,7cyclictest131rcu_preempt20:15:242
3588473992721,3cyclictest0-21swapper/119:45:251
3588473992721,3cyclictest0-21swapper/119:45:241
3588473992720,3cyclictest0-21swapper/122:45:221
3588473992719,5cyclictest0-21swapper/100:00:151
3588473992719,5cyclictest0-21swapper/100:00:151
358846999276,5cyclictest0-21swapper/022:15:210
358846999274,20cyclictest3627821-21ps21:00:230
3588469992719,5cyclictest0-21swapper/020:05:000
3588469992719,4cyclictest0-21swapper/019:20:140
3588469992712,12cyclictest3692442-21cron00:07:590
3588469992712,11cyclictest0-21swapper/020:40:110
358846999270,4cyclictest11-21ksoftirqd/019:35:230
358848299265,11cyclictest131rcu_preempt22:11:563
358848299263,12cyclictest3638544-21kworker/3:2-events23:36:413
358848299261,14cyclictest0-21swapper/300:11:003
358847799269,9cyclictest131rcu_preempt21:15:012
3588477992618,5cyclictest0-21swapper/200:25:162
3588477992613,5cyclictest3664754-21kworker/u8:1+events_unbound22:51:112
3588473992619,3cyclictest0-21swapper/120:30:261
3588473992618,4cyclictest0-21swapper/122:05:261
3588473992618,4cyclictest0-21swapper/119:40:191
3588473992614,8cyclictest3592428-21sendmail19:20:001
358846999266,4cyclictest151rcuc/023:40:210
358846999264,19cyclictest3601226-21latency_hist19:45:010
3588469992620,3cyclictest13550irq/42-30be0000.ethernet23:05:180
3588469992616,3cyclictest131rcu_preempt23:45:190
3588469992612,11cyclictest3694068-21cron00:12:010
3588469992611,8cyclictest131rcu_preempt00:30:140
358848299259,9cyclictest40-21ksoftirqd/319:15:043
358848299255,10cyclictest131rcu_preempt20:13:073
358848299252,5cyclictest0-21swapper/319:35:123
3588482992519,4cyclictest3613993-21kworker/u8:2+events_unbound20:20:413
3588482992519,3cyclictest0-21swapper/323:00:253
3588482992518,5cyclictest3664754-21kworker/u8:1+events_unbound22:50:223
3588482992516,6cyclictest381rcuc/322:45:093
3588482992515,7cyclictest3695331-21ntpq00:15:203
358848299251,12cyclictest0-21swapper/320:15:153
358848299250,12cyclictest0-21swapper/300:38:543
358847799258,11cyclictest0-21swapper/223:35:202
358847799253,11cyclictest0-21swapper/222:23:012
3588477992518,5cyclictest3640428-21kworker/u8:1+events_unbound22:04:152
3588477992518,3cyclictest0-21swapper/223:30:282
3588477992517,5cyclictest0-21swapper/221:30:242
3588477992515,6cyclictest0-21swapper/200:15:222
3588477992513,6cyclictest3640428-21kworker/u8:1+events_unbound21:43:332
3588477992513,6cyclictest3640428-21kworker/u8:1+events_unbound21:43:332
358847799251,13cyclictest0-21swapper/222:39:282
3588473992518,4cyclictest3643543-21unixbench_multi21:45:241
3588473992517,5cyclictest3673216-21grep23:10:241
3588473992516,6cyclictest3671382-21grep23:05:241
3588473992515,6cyclictest0-21swapper/123:40:001
3588469992519,3cyclictest0-21swapper/020:15:020
3588469992518,4cyclictest0-21swapper/023:55:150
3588469992512,10cyclictest3678807-21cron23:28:010
358848299249,5cyclictest131rcu_preempt23:50:243
3588482992415,7cyclictest3604237-21kworker/u8:2+events_unbound20:01:383
358847799247,10cyclictest32-21ksoftirqd/220:20:212
358847799247,10cyclictest32-21ksoftirqd/200:20:232
3588477992418,4cyclictest3654180-21kworker/u8:2+events_unbound22:43:002
3588477992417,5cyclictest3681867-21kworker/u8:2+events_unbound23:45:172
3588477992417,4cyclictest3675347-21latency_hist23:20:002
3588477992417,4cyclictest0-21swapper/223:25:242
3588477992415,7cyclictest3681867-21kworker/u8:2+events_unbound23:55:242
358846999247,13cyclictest3664699-21unixbench_singl22:45:220
358846999241,5cyclictest3623774-21apt-get20:50:110
3588469992414,7cyclictest121ktimers/023:35:120
3588469992412,9cyclictest3644355-21/usr/sbin/munin21:50:130
3588477992317,3cyclictest0-21swapper/219:25:202
358847799231,3cyclictest131rcu_preempt19:15:162
3588473992317,4cyclictest3594545-21fschecks_time19:25:171
3588473992315,4cyclictest0-21swapper/122:20:271
3588473992313,7cyclictest0-21swapper/120:35:181
3588477992216,4cyclictest3604237-21kworker/u8:2+events_unbound20:00:192
358847799221,12cyclictest0-21swapper/222:13:122
3588473992216,3cyclictest0-21swapper/121:00:011
3588473992214,4cyclictest0-21swapper/120:25:161
3588473992115,3cyclictest0-21swapper/122:00:161
3588473991913,3cyclictest0-21swapper/100:30:131
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional