You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-09-07 - 13:25

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #b, slot #5

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  Phytec
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.

Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the 792 highest latencies:
System rackbslot5s.osadl.org (updated Mon Sep 07, 2026 00:44:47)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
3561498995330,20cyclictest3642635-21cron23:04:590
3561498995330,20cyclictest3642635-21cron23:04:590
3561508995239,9cyclictest3620256-21sendmail22:00:003
3561508994840,5cyclictest3630494-21cut22:30:003
3561504994842,4cyclictest3571889-21kworker/u8:0+events_unbound19:41:172
3561500994839,6cyclictest0-21swapper/122:50:011
3561498994833,11cyclictest121ktimers/022:55:120
3561498994833,11cyclictest121ktimers/022:55:120
3561498994815,29cyclictest0-21swapper/020:00:280
3561498994720,23cyclictest0-21swapper/021:15:000
3561498994710,10cyclictest13550irq/42-30be0000.ethernet19:20:100
3561504994639,4cyclictest3675258-21sendmail00:39:592
3561498994336,5cyclictest3627063-21cron22:20:000
356149899422,18cyclictest3563245-21idleruntime-cro19:15:020
3561498994217,4cyclictest0-21swapper/021:30:270
3561504994131,6cyclictest3661608-21cron00:00:012
3561500994133,5cyclictest3589333-21cut20:30:011
3561500994133,5cyclictest3589333-21cut20:30:001
3561500994033,4cyclictest3565448-21munin-plugin-st19:20:011
3561500994026,10cyclictest231ktimers/122:30:141
3561498994033,4cyclictest3663313-21cron00:05:000
3561498994026,11cyclictest121ktimers/020:10:130
3561508993931,4cyclictest3666738-21munin-plugin-st00:15:013
3561504993933,4cyclictest3637026-21kworker/u8:1+events_unbound23:18:402
3561500993932,4cyclictest3659503-21grep23:50:261
3561500993930,6cyclictest3612112-21fschecks_count21:35:171
3561498993914,4cyclictest0-21swapper/019:35:260
3561498993726,6cyclictest0-21swapper/020:20:270
3561504993618,6cyclictest131rcu_preempt21:35:132
3561508993528,5cyclictest3604640-21kworker/u8:1+events_unbound21:16:343
3561508993528,4cyclictest3627056-21cron22:20:003
3561508993527,4cyclictest3661170-21unixbench_singl23:55:263
3561508993523,7cyclictest0-21swapper/323:40:003
3561504993527,4cyclictest0-21swapper/219:45:162
3561504993524,8cyclictest3597965-21latency_hist20:55:012
3561504993524,7cyclictest3643898-21grep23:05:272
3561504993524,7cyclictest0-21swapper/219:15:012
356150499352,18cyclictest32-21ksoftirqd/223:35:112
3561500993525,7cyclictest3597432-21grep20:50:261
3561498993526,6cyclictest0-21swapper/020:55:260
3561498993516,3cyclictest0-21swapper/020:46:300
3561508993425,4cyclictest0-21swapper/319:15:263
3561508993425,4cyclictest0-21swapper/300:40:003
3561508993423,7cyclictest0-21swapper/322:10:013
3561508993423,7cyclictest0-21swapper/320:15:253
356150499349,5cyclictest131rcu_preempt20:35:132
3561504993426,3cyclictest0-21swapper/220:20:012
3561500993426,4cyclictest0-21swapper/123:55:171
3561498993423,6cyclictest0-21swapper/023:20:250
3561498993423,6cyclictest0-21swapper/019:30:260
3561508993326,3cyclictest0-21swapper/319:35:173
3561508993325,4cyclictest0-21swapper/323:15:273
3561508993325,4cyclictest0-21swapper/319:15:023
3561508993323,7cyclictest645-21runrttasks20:35:253
3561504993327,4cyclictest3621639-21kworker/u8:1+events_unbound22:11:462
3561504993326,3cyclictest0-21swapper/221:20:152
3561504993326,3cyclictest0-21swapper/221:20:152
3561504993324,7cyclictest3568464-21kworker/u8:2+events_unbound19:31:162
3561500993325,4cyclictest0-21swapper/119:55:181
3561498993326,3cyclictest0-21swapper/021:40:000
3561498993325,4cyclictest0-21swapper/023:15:270
3561498993324,5cyclictest0-21swapper/023:06:520
3561498993323,6cyclictest0-21swapper/020:35:010
3561508993225,4cyclictest0-21swapper/320:45:253
3561508993220,8cyclictest3594446-21debian-sa120:45:003
3561504993224,4cyclictest0-21swapper/220:35:002
3561504993223,5cyclictest3581200-21fschecks_count20:05:162
3561504993223,4cyclictest0-21swapper/221:35:002
3561504993223,4cyclictest0-21swapper/200:18:412
3561504993221,8cyclictest311ktimers/220:00:142
3561500993225,4cyclictest0-21swapper/100:25:261
3561500993220,8cyclictest0-21swapper/123:35:161
3561498993225,4cyclictest0-21swapper/019:45:250
3561498993223,6cyclictest0-21swapper/020:45:000
3561498993222,6cyclictest0-21swapper/022:25:150
3561498993215,3cyclictest0-21swapper/023:30:340
3561508993124,4cyclictest3642635-21cron23:05:003
3561508993124,4cyclictest3642635-21cron23:04:593
3561508993123,4cyclictest0-21swapper/320:25:163
3561508993123,4cyclictest0-21swapper/320:25:153
3561508993123,3cyclictest0-21swapper/300:25:253
3561508993122,5cyclictest0-21swapper/319:45:013
3561504993124,5cyclictest3616700-21kworker/u8:2+events_unbound22:01:432
3561504993124,3cyclictest0-21swapper/221:10:182
3561504993122,5cyclictest3640248-21grep22:55:242
3561504993122,5cyclictest3640248-21grep22:55:242
3561504993122,4cyclictest0-21swapper/200:30:152
3561500993124,4cyclictest0-21swapper/123:00:261
3561500993124,4cyclictest0-21swapper/123:00:261
3561500993123,4cyclictest0-21swapper/121:20:251
3561500993123,4cyclictest0-21swapper/121:20:241
3561500993120,7cyclictest0-21swapper/123:11:541
356149899317,21cyclictest3673790-21apt-get00:35:150
3561498993121,6cyclictest0-21swapper/000:15:250
3561498993119,8cyclictest3598031-21latency_hist20:55:010
3561508993023,4cyclictest0-21swapper/319:30:263
3561508993019,8cyclictest438-21cron20:10:013
356150499301,4cyclictest131rcu_preempt23:20:132
3561500993021,6cyclictest3570160-21unixbench_singl19:30:271
3561498993021,5cyclictest0-21swapper/022:10:010
3561498993020,6cyclictest0-21swapper/021:05:250
3561508992921,4cyclictest0-21swapper/300:05:183
3561508992919,6cyclictest0-21swapper/300:05:003
3561504992923,3cyclictest0-21swapper/222:25:252
3561504992922,5cyclictest3637026-21kworker/u8:1+events_unbound22:48:412
3561504992921,5cyclictest0-21swapper/219:15:252
3561500992921,4cyclictest0-21swapper/120:21:271
3561500992919,7cyclictest3622372-21tune2fs22:05:161
3561498992919,6cyclictest0-21swapper/022:00:230
356149899291,2cyclictest0-21swapper/000:05:150
3561508992820,4cyclictest0-21swapper/323:05:263
3561508992819,4cyclictest0-21swapper/321:55:013
3561508992818,7cyclictest3566701-21unixbench_multi19:20:233
3561504992822,4cyclictest3571889-21kworker/u8:0+events_unbound19:56:022
3561504992820,4cyclictest0-21swapper/200:20:172
3561504992818,6cyclictest0-21swapper/221:15:262
356150499281,4cyclictest131rcu_preempt19:35:132
356150499281,4cyclictest131rcu_preempt00:10:142
3561500992821,4cyclictest0-21swapper/122:20:251
3561500992820,5cyclictest0-21swapper/120:00:281
3561500992820,4cyclictest0-21swapper/122:55:151
3561500992820,4cyclictest0-21swapper/122:55:151
3561500992820,4cyclictest0-21swapper/121:00:011
3561498992821,4cyclictest0-21swapper/019:15:170
3561498992820,5cyclictest0-21swapper/019:30:000
3561498992815,8cyclictest0-21swapper/021:56:410
3561508992720,4cyclictest3610015-21idleruntime-cro21:30:013
3561508992720,3cyclictest0-21swapper/323:10:273
3561508992719,5cyclictest0-21swapper/319:45:253
3561508992719,4cyclictest3616415-21grep21:45:273
3561508992717,6cyclictest0-21swapper/320:50:253
3561504992716,7cyclictest3602712-21grep21:05:262
3561504992715,9cyclictest3568061-21cut19:25:242
3561500992721,3cyclictest0-21swapper/119:15:021
3561500992720,3cyclictest0-21swapper/100:34:001
3561500992716,8cyclictest3591023-21apt20:35:001
3561498992720,3cyclictest0-21swapper/022:10:280
3561498992717,6cyclictest0-21swapper/021:30:000
3561508992620,3cyclictest0-21swapper/321:10:013
3561508992620,3cyclictest0-21swapper/300:18:413
3561508992619,4cyclictest0-21swapper/323:25:013
3561508992619,3cyclictest0-21swapper/322:00:233
3561508992618,6cyclictest3650836-21kworker/u8:1+events_unbound23:42:113
3561508992616,6cyclictest0-21swapper/321:30:183
3561504992619,5cyclictest3587480-21kworker/u8:0+events_unbound20:25:142
3561504992619,5cyclictest3587480-21kworker/u8:0+events_unbound20:25:142
3561504992618,4cyclictest0-21swapper/221:00:262
3561504992612,5cyclictest3580759-21kworker/u8:0+events_unbound20:14:132
3561500992619,3cyclictest0-21swapper/122:40:001
3561500992617,6cyclictest0-21swapper/121:00:161
356150099261,22cyclictest0-21swapper/119:20:101
3561498992618,5cyclictest3573241-21cat19:40:260
3561498992618,5cyclictest0-21swapper/000:00:000
3561498992617,6cyclictest0-21swapper/021:20:000
3561508992519,3cyclictest0-21swapper/323:30:163
3561508992519,3cyclictest0-21swapper/319:51:183
3561508992518,5cyclictest3637026-21kworker/u8:1+events_unbound22:51:503
3561508992517,5cyclictest0-21swapper/321:40:003
3561508992516,6cyclictest3567606-21fschecks_time19:25:163
3561504992520,3cyclictest3655771-21timerwakeupswit23:40:252
3561504992519,4cyclictest3610244-21kworker/u8:3+events_unbound21:40:172
3561504992518,5cyclictest3585528-21kworker/u8:1+events_unbound20:57:262
3561504992517,5cyclictest311ktimers/220:50:012
3561504992517,5cyclictest0-21swapper/222:20:252
3561504992515,7cyclictest3664098-21ntpq00:05:212
3561504992514,7cyclictest0-21swapper/220:20:282
356150499251,12cyclictest0-21swapper/219:21:012
3561500992517,4cyclictest0-21swapper/120:20:001
3561498992518,3cyclictest0-21swapper/023:41:440
3561498992516,6cyclictest3616833-21sh21:50:010
3561498992516,5cyclictest0-21swapper/021:45:010
3561508992418,4cyclictest3658003-21idleruntime-cro23:50:013
3561508992417,3cyclictest0-21swapper/321:10:263
3561504992418,3cyclictest0-21swapper/220:40:222
3561504992417,4cyclictest0-21swapper/222:05:152
3561504992417,3cyclictest0-21swapper/223:25:172
3561504992417,3cyclictest0-21swapper/223:00:272
3561504992417,3cyclictest0-21swapper/223:00:272
3561500992418,3cyclictest0-21swapper/121:30:211
3561500992418,3cyclictest0-21swapper/120:40:221
3561500992417,4cyclictest3657991-21latency_hist23:50:001
3561500992417,4cyclictest0-21swapper/121:55:161
3561500992416,5cyclictest231ktimers/122:00:241
3561500992416,5cyclictest0-21swapper/122:25:261
3561500992416,4cyclictest0-21swapper/122:50:191
3561500992415,6cyclictest3668426-21sh00:20:001
3561500992415,5cyclictest3627059-21cron22:20:001
3561500992413,8cyclictest3617425-21cut21:50:211
3561498992418,3cyclictest3577445-21latency_hist19:55:010
3561498992418,3cyclictest0-21swapper/023:35:200
3561498992414,6cyclictest0-21swapper/022:30:270
356149899241,3cyclictest3581038-21apt-get20:05:140
356149899241,19cyclictest0-21swapper/023:10:330
356149899241,19cyclictest0-21swapper/022:47:170
356149899241,19cyclictest0-21swapper/021:52:200
356149899241,19cyclictest0-21swapper/021:01:170
356149899241,19cyclictest0-21swapper/000:31:580
356149899241,19cyclictest0-21swapper/000:11:520
3561508992317,3cyclictest0-21swapper/322:55:243
3561508992317,3cyclictest0-21swapper/322:55:243
3561508992317,3cyclictest0-21swapper/322:21:463
3561508992315,4cyclictest3598478-21fschecks_time20:55:163
3561508992315,3cyclictest0-21swapper/321:20:203
3561508992315,3cyclictest0-21swapper/321:20:203
3561508992313,6cyclictest3615136-21apt21:45:003
3561508992313,6cyclictest0-21swapper/322:40:223
3561508992313,6cyclictest0-21swapper/320:10:183
356150499237,8cyclictest32-21ksoftirqd/223:30:192
3561504992317,4cyclictest3662007-21fschecks_count00:00:172
3561504992316,4cyclictest3630890-21fschecks_count22:30:162
3561504992315,5cyclictest3610036-21cat21:30:012
3561504992314,6cyclictest0-21swapper/222:50:232
3561504992312,8cyclictest0-21swapper/221:50:162
3561500992317,3cyclictest0-21swapper/121:25:151
3561500992317,3cyclictest0-21swapper/100:10:161
3561500992315,5cyclictest0-21swapper/100:35:261
3561500992313,7cyclictest3602778-21unixbench_singl21:05:251
3561500992313,6cyclictest3670157-21basename00:25:011
3561500992310,3cyclictest0-21swapper/121:16:311
356149899231,9cyclictest3577615-21apt-get19:55:120
3561498992317,3cyclictest13550irq/42-30be0000.ethernet20:15:210
3561498992317,3cyclictest0-21swapper/023:25:220
3561498992316,3cyclictest0-21swapper/022:50:180
356149899231,4cyclictest3657096-21ntp_states23:45:210
3561498992313,7cyclictest3588843-21grep20:25:250
3561498992313,7cyclictest3588843-21grep20:25:240
356149899231,19cyclictest3657989-21apt-get23:50:030
356149899231,18cyclictest0-21swapper/021:21:300
356149899231,18cyclictest0-21swapper/021:21:300
356149899230,11cyclictest3634514-21grep22:40:190
3561508992214,6cyclictest391ktimers/320:21:263
3561504992216,4cyclictest3571889-21kworker/u8:0+events_unbound19:53:402
3561504992216,3cyclictest0-21swapper/221:45:232
3561504992215,5cyclictest3631895-21kworker/u8:0+events_unbound22:35:242
3561504992214,6cyclictest311ktimers/223:10:182
3561504992214,5cyclictest311ktimers/223:50:012
3561504992214,4cyclictest3620263-21idleruntime-cro22:00:012
356150499220,20cyclictest311ktimers/222:15:232
3561500992216,3cyclictest0-21swapper/123:20:181
3561500992216,3cyclictest0-21swapper/121:45:131
3561500992216,3cyclictest0-21swapper/119:45:161
3561500992216,3cyclictest0-21swapper/100:00:221
3561500992215,4cyclictest3582030-21grep20:05:261
3561500992214,5cyclictest3613849-21fschecks_count21:40:181
3561500992213,6cyclictest3567954-21ntp_states19:25:221
356149899229,9cyclictest204-21dbus-daemon22:36:480
356149899221,19cyclictest0-21swapper/000:20:120
356149899220,18cyclictest0-21swapper/022:22:430
356149899220,18cyclictest0-21swapper/000:26:300
3561508992115,3cyclictest0-21swapper/323:25:203
3561508992114,4cyclictest3591172-21latency_hist20:35:013
3561508992114,3cyclictest0-21swapper/322:46:483
3561508992114,3cyclictest0-21swapper/321:00:263
3561500992115,3cyclictest645-21runrttasks23:15:221
3561500992115,3cyclictest0-21swapper/122:10:181
356150099211,4cyclictest0-21swapper/123:08:111
3561500992114,4cyclictest438-21cron00:10:011
3561500992114,4cyclictest231ktimers/119:37:011
3561500992111,7cyclictest3595209-21tr20:45:211
3561498992113,5cyclictest0-21swapper/020:35:250
356150899202,12cyclictest3631740-21grep22:30:263
3561508992014,3cyclictest0-21swapper/320:05:003
3561508992013,4cyclictest3633878-21cron22:40:013
3561508992013,4cyclictest3577612-21/usr/sbin/munin19:55:233
3561508992011,6cyclictest3659061-21wc23:50:233
356150499204,3cyclictest131rcu_preempt23:50:182
356150099209,8cyclictest3603535-21df_inode21:10:161
3561500992014,3cyclictest3651404-21/usr/sbin/munin23:30:261
3561500992012,4cyclictest0-21swapper/119:40:181
3561500992011,7cyclictest231ktimers/119:50:111
3561508991914,3cyclictest3672082-21/usr/sbin/munin00:30:143
3561508991912,5cyclictest391ktimers/322:10:163
3561500991913,4cyclictest3654824-21/usr/sbin/munin23:40:161
3561500991913,3cyclictest0-21swapper/120:40:001
3561500991812,3cyclictest3649704-21/usr/sbin/munin23:25:191
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional