You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-04-29 - 15:27

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #b, slot #5

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  Phytec
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.

Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the 376 highest latencies:
System rackbslot5s.osadl.org (updated Wed Apr 29, 2026 12:44:47)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
4116308995839,14cyclictest4194197-21latency_hist10:55:013
4116308995839,14cyclictest4194197-21latency_hist10:55:003
411630899510,43cyclictest0-21swapper/308:25:133
4116308994941,4cyclictest4130481-21ls07:49:593
411630899491,37cyclictest645-21runrttasks07:15:113
411630899491,28cyclictest9936-21mailstats11:20:233
4116308994841,4cyclictest36258-21grep12:40:003
4116301994839,5cyclictest15796-21munin-plugin-st11:40:011
4116297994733,11cyclictest121ktimers/009:00:130
4116308994633,10cyclictest4140701-21apt-get08:19:593
4116301994636,6cyclictest4150685-21grep08:45:251
4116308994524,17cyclictest0-21swapper/308:55:163
4116301994533,9cyclictest231ktimers/110:40:121
4116297994538,4cyclictest4178451-21idleruntime-cro10:10:010
4116303994437,4cyclictest8973-21munin-plugin-st11:20:002
4116297994437,4cyclictest4164810-21idleruntime-cro09:30:000
411630899431,36cyclictest4163879-21/usr/sbin/munin09:25:213
411630899430,39cyclictest0-21swapper/311:25:113
4116303994334,6cyclictest4126568-21grep07:35:232
4116301994335,5cyclictest19217-21idleruntime-cro11:50:001
4116297994332,7cyclictest4157500-21grep09:05:250
4116297994329,10cyclictest121ktimers/009:20:130
411630899421,37cyclictest4170263-21/usr/sbin/munin09:45:153
411630899421,36cyclictest4146539-21/usr/sbin/munin08:35:163
411630899421,36cyclictest22981-21diskstats12:00:143
411630899421,34cyclictest487-21sendmail-mta07:50:123
4116303994230,7cyclictest0-21swapper/209:43:092
411630899412,36cyclictest4812-21/usr/sbin/munin11:05:233
411630899411,37cyclictest4191438-21/usr/sbin/munin10:45:223
411630899411,37cyclictest4191438-21/usr/sbin/munin10:45:223
411630899411,37cyclictest30058-21/usr/sbin/munin12:20:193
411630899411,35cyclictest4184119-21/usr/sbin/munin10:25:143
411630899411,35cyclictest4175412-21/usr/sbin/munin10:00:163
411630899411,35cyclictest4168975-21/usr/sbin/munin09:40:203
411630899411,35cyclictest4156954-21meminfo09:05:183
411630899411,35cyclictest4135833-21/usr/sbin/munin08:05:123
411630899411,35cyclictest4125585-21apt-get07:35:103
4116303994129,8cyclictest311ktimers/212:35:112
4116301994130,8cyclictest231ktimers/109:35:121
4116297994133,4cyclictest0-21swapper/010:18:140
411630899406,30cyclictest41342282sleep308:00:153
4116308994033,4cyclictest0-21swapper/310:40:003
411630899402,35cyclictest15537-21sshd11:37:053
411630899401,36cyclictest4189682-21/usr/sbin/munin10:40:203
411630899401,36cyclictest4172829-21/usr/sbin/munin09:50:253
411630899401,34cyclictest4173559-21apt-get09:55:133
411630899401,34cyclictest4160033-21diskstats09:15:153
411630899401,34cyclictest4160033-21diskstats09:15:153
411630899401,34cyclictest4127595-21/usr/sbin/munin07:40:183
411630899401,34cyclictest4116732-21/usr/sbin/munin07:10:163
4116297994026,11cyclictest121ktimers/009:45:130
411630899393,33cyclictest4133547-21sshd07:56:053
411630899391,35cyclictest794-21irqstats10:55:183
411630899391,35cyclictest4140701-21apt-get08:20:053
411630899391,34cyclictest4152591-21cron08:52:013
411630899391,34cyclictest4148826-21/usr/sbin/munin08:40:243
411630899391,34cyclictest4124004-21/usr/sbin/munin07:30:143
411630899391,34cyclictest19429-21sshd11:50:063
411630899391,33cyclictest7589-21/usr/sbin/munin11:15:133
411630899391,33cyclictest5908-21diskstats11:10:143
411630899391,33cyclictest5908-21diskstats11:10:143
411630899391,33cyclictest4176976-21/usr/sbin/munin10:05:113
411630899391,33cyclictest28083-21diskstats12:15:153
411630899391,33cyclictest18338-21/usr/sbin/munin11:45:213
411630899391,33cyclictest16597-21/usr/sbin/munin11:40:203
411630899391,32cyclictest4149689-21apt-get08:45:103
4116303993932,4cyclictest0-21swapper/208:20:002
4116303993929,7cyclictest4179660-21grep10:10:262
4116303993929,7cyclictest4176731-21cron10:05:012
4116301993930,6cyclictest29901-21fschecks_time12:20:171
4116297993931,4cyclictest0-21swapper/007:35:010
411630899382,32cyclictest4122189-21apt-get07:25:143
4116308993818,17cyclictest4180371-21/usr/sbin/munin10:15:173
411630899381,34cyclictest4179518-21/usr/sbin/munin10:10:253
411630899381,34cyclictest4158371-21/usr/sbin/munin09:10:153
411630899381,34cyclictest4144687-21/usr/sbin/munin08:30:153
411630899381,34cyclictest4137643-21/usr/sbin/munin08:10:143
411630899381,34cyclictest24772-21/usr/sbin/munin12:05:163
411630899381,34cyclictest22219-21uptime11:55:263
411630899381,34cyclictest13528-21/usr/sbin/munin11:30:233
411630899381,33cyclictest4183482-21sshd10:24:053
411630899381,33cyclictest4120474-21sshd07:20:053
411630899381,32cyclictest4154927-21diskstats09:00:153
411630899381,32cyclictest33205-21/usr/sbin/munin12:30:153
411630899381,31cyclictest4185815-21df10:30:133
411630899380,33cyclictest4161637-21apt-get09:20:123
4116303993831,4cyclictest0-21swapper/210:55:002
4116303993831,4cyclictest0-21swapper/210:55:002
4116303993829,5cyclictest0-21swapper/209:28:062
4116303993828,7cyclictest0-21swapper/207:10:242
411630899375,28cyclictest4166722-21sshd09:35:053
411630899371,33cyclictest4166110-21/usr/sbin/munin09:30:263
411630899371,33cyclictest31839-21memory12:25:223
411630899371,33cyclictest2285-21df11:00:133
411630899370,32cyclictest26262-21apt-get12:10:123
4116303993730,5cyclictest4112386-21kworker/u8:2+events_unbound07:27:412
4116301993729,4cyclictest0-21swapper/112:00:141
4116301993727,6cyclictest0-21swapper/111:05:011
4116301993726,7cyclictest0-21swapper/108:10:011
4116297993727,6cyclictest0-21swapper/008:25:250
4116297993725,9cyclictest121ktimers/008:45:110
4116303993629,4cyclictest4147750-21sendmail08:40:012
4116303993627,7cyclictest4149461-21idleruntime-cro08:45:012
4116303993624,9cyclictest311ktimers/212:20:132
4116301993626,6cyclictest0-21swapper/110:20:001
4116297993625,6cyclictest0-21swapper/010:40:250
4116297993623,4cyclictest127452entropy11:30:140
4116303993528,4cyclictest0-21swapper/208:10:162
4116301993527,5cyclictest36257-21munin-plugin-st12:40:001
4116301993527,4cyclictest0-21swapper/108:00:011
4116301993526,6cyclictest4126602-21grep07:35:221
4116301993526,5cyclictest4182618-21seq10:20:191
4116301993524,7cyclictest0-21swapper/108:00:251
4116297993528,4cyclictest10265-21unixbench_singl11:20:250
4116297993526,5cyclictest0-21swapper/012:20:000
4116297993525,6cyclictest0-21swapper/011:40:010
4116297993525,5cyclictest0-21swapper/009:13:030
411629799352,30cyclictest0-21swapper/012:30:110
4116301993426,5cyclictest34543-21cron12:35:001
4116301993426,4cyclictest4138553-21unixbench_multi08:10:251
4116301993424,7cyclictest645-21runrttasks07:40:261
4116297993428,4cyclictest4168211-21munin-plugin-st09:40:010
4116297993426,4cyclictest0-21swapper/009:30:250
4116297993424,6cyclictest4149026-21grep08:40:240
4116303993326,4cyclictest4137294-21cron08:10:012
4116301993324,5cyclictest0-21swapper/111:00:011
4116301993323,6cyclictest0-21swapper/108:30:011
4116301993322,7cyclictest0-21swapper/109:50:251
4116301993319,10cyclictest231ktimers/107:20:111
4116297993325,5cyclictest26028-21cron12:10:000
4116297993324,5cyclictest0-21swapper/009:50:260
4116297993324,5cyclictest0-21swapper/007:25:280
4116297993323,6cyclictest0-21swapper/009:40:250
4116303993225,4cyclictest0-21swapper/210:15:252
4116303993223,6cyclictest0-21swapper/209:45:252
4116303993222,6cyclictest0-21swapper/211:25:242
4116301993223,5cyclictest0-21swapper/110:25:261
4116297993225,3cyclictest0-21swapper/008:19:590
4116303993124,5cyclictest4100747-21kworker/u8:0+events_unbound07:22:412
4116303993124,4cyclictest0-21swapper/210:55:162
4116303993124,4cyclictest0-21swapper/208:55:262
4116303993123,5cyclictest0-21swapper/211:50:242
4116303993123,5cyclictest0-21swapper/209:10:162
4116303993121,7cyclictest4191830-21grep10:45:242
4116303993121,7cyclictest4191830-21grep10:45:242
4116301993121,7cyclictest0-21swapper/109:00:011
4116301993121,6cyclictest0-21swapper/109:15:241
4116301993121,6cyclictest0-21swapper/109:15:241
4116297993118,9cyclictest121ktimers/008:00:130
4116303993023,3cyclictest17519-21idleruntime-cro11:45:012
4116303993022,4cyclictest4161400-21sendmail09:20:002
4116303993022,4cyclictest4161400-21sendmail09:19:592
4116301993020,7cyclictest231ktimers/111:25:121
4116301993019,7cyclictest0-21swapper/108:30:241
4116297993023,3cyclictest0-21swapper/010:45:150
4116297993023,3cyclictest0-21swapper/010:45:150
4116297993022,5cyclictest0-21swapper/008:55:010
4116297993022,4cyclictest0-21swapper/007:55:010
4116297993022,4cyclictest0-21swapper/007:40:260
4116303992922,5cyclictest12065-21kworker/u8:1+events_unbound11:48:342
4116303992918,7cyclictest0-21swapper/211:55:242
411630399291,10cyclictest41418822mailstats08:20:222
4116301992923,3cyclictest22755-21latency_hist12:00:011
4116301992921,4cyclictest0-21swapper/112:05:251
4116301992921,4cyclictest0-21swapper/110:35:251
4116301992921,4cyclictest0-21swapper/110:30:261
4116301992921,4cyclictest0-21swapper/109:15:001
4116301992921,4cyclictest0-21swapper/109:00:241
4116301992920,6cyclictest0-21swapper/111:50:251
4116297992922,4cyclictest0-21swapper/010:55:260
4116297992922,4cyclictest0-21swapper/010:20:250
4116303992822,3cyclictest32853-21sh12:30:002
4116303992821,5cyclictest4184001-21kworker/u8:0+events_unbound11:13:262
4116303992821,5cyclictest4184001-21kworker/u8:0+events_unbound11:13:262
4116303992821,4cyclictest0-21swapper/210:30:262
4116303992821,3cyclictest0-21swapper/210:25:262
4116303992820,4cyclictest4166093-21head09:30:262
4116303992820,4cyclictest0-21swapper/210:25:002
4116303992820,4cyclictest0-21swapper/207:15:262
4116303992818,6cyclictest0-21swapper/210:35:252
4116303992817,8cyclictest4190134-21grep10:40:242
4116301992821,4cyclictest4178445-21kthreadd10:10:011
4116301992821,4cyclictest0-21swapper/111:10:151
4116301992821,4cyclictest0-21swapper/111:10:151
4116301992821,3cyclictest0-21swapper/109:25:011
4116301992820,5cyclictest4164331-21unixbench_multi09:25:241
4116301992820,4cyclictest0-21swapper/110:50:271
4116301992820,4cyclictest0-21swapper/110:50:271
4116301992818,6cyclictest0-21swapper/111:40:251
4116301992818,6cyclictest0-21swapper/107:10:241
4116297992822,3cyclictest0-21swapper/012:20:260
4116297992822,3cyclictest0-21swapper/007:45:140
4116297992821,4cyclictest13850irq/36-mmc112:39:590
4116297992819,6cyclictest0-21swapper/010:35:250
4116297992818,7cyclictest4117453-21grep07:10:240
4116303992721,3cyclictest0-21swapper/209:50:242
4116303992720,3cyclictest0-21swapper/209:00:162
4116303992717,7cyclictest4133903-21basename08:00:002
4116303992716,8cyclictest4162674-21grep09:20:252
4116301992717,6cyclictest0-21swapper/110:50:001
4116301992717,6cyclictest0-21swapper/110:49:591
4116301992714,10cyclictest32869-21basename12:30:001
4116297992718,6cyclictest5620-21grep11:10:000
4116303992620,3cyclictest0-21swapper/207:55:012
4116303992618,5cyclictest0-21swapper/212:05:252
4116303992618,5cyclictest0-21swapper/209:55:172
4116301992619,4cyclictest4120227-21cron07:20:011
4116301992619,4cyclictest0-21swapper/107:30:231
4116301992618,4cyclictest0-21swapper/109:08:011
4116301992618,4cyclictest0-21swapper/108:15:251
4116301992617,6cyclictest9407-21fschecks_time11:20:151
4116301992615,7cyclictest0-21swapper/110:00:261
4116301992614,8cyclictest0-21swapper/111:20:001
4116297992620,3cyclictest0-21swapper/009:20:000
4116297992620,3cyclictest0-21swapper/009:20:000
4116297992618,5cyclictest0-21swapper/008:40:010
4116297992616,7cyclictest4119785-21grep07:15:260
4116303992519,3cyclictest0-21swapper/212:30:252
4116303992519,3cyclictest0-21swapper/212:05:002
4116303992519,3cyclictest0-21swapper/208:00:162
4116303992517,4cyclictest0-21swapper/212:20:002
4116303992516,5cyclictest4143026-21fschecks_count08:25:152
4116303992515,6cyclictest0-21swapper/208:30:242
4116301992518,3cyclictest0-21swapper/111:05:161
4116301992517,5cyclictest0-21swapper/107:25:281
4116301992515,6cyclictest0-21swapper/107:50:001
4116301992514,7cyclictest0-21swapper/109:30:171
4116297992518,4cyclictest4144728-21fschecks_count08:30:150
4116297992518,4cyclictest0-21swapper/008:05:260
4116303992418,3cyclictest0-21swapper/211:10:002
4116303992418,3cyclictest0-21swapper/208:45:252
4116303992417,3cyclictest0-21swapper/207:40:242
4116303992414,7cyclictest4152398-21grep08:50:252
4116303992413,7cyclictest0-21swapper/209:05:192
4116303992412,8cyclictest15267-21grep11:35:252
4116301992418,3cyclictest0-21swapper/109:45:231
4116297992417,3cyclictest0-21swapper/011:28:030
4116297992417,3cyclictest0-21swapper/011:15:230
4116297992416,5cyclictest11-21ksoftirqd/007:35:100
4116297992416,5cyclictest0-21swapper/008:10:250
4116297992413,8cyclictest204-21dbus-daemon11:13:240
4116297992413,8cyclictest204-21dbus-daemon11:13:230
411629799241,19cyclictest0-21swapper/011:55:200
411629799241,19cyclictest0-21swapper/011:49:290
411629799241,19cyclictest0-21swapper/008:22:550
411629799241,10cyclictest4154561-21munin-run09:00:010
411629799240,20cyclictest0-21swapper/010:00:260
4116303992313,6cyclictest0-21swapper/211:30:232
4116301992315,6cyclictest4138964-21kworker/u8:2+events_unbound08:38:161
4116297992317,3cyclictest0-21swapper/009:55:240
4116297992316,3cyclictest0-21swapper/012:10:220
4116297992315,5cyclictest13550irq/42-30be0000.ethernet07:55:160
4116297992314,5cyclictest0-21swapper/010:50:210
4116297992314,5cyclictest0-21swapper/010:50:200
4116297992314,5cyclictest0-21swapper/010:30:000
411629799231,19cyclictest19887-21/usr/sbin/munin11:50:180
411629799231,18cyclictest0-21swapper/010:14:330
4116303992215,4cyclictest0-21swapper/211:20:152
4116303992213,6cyclictest4125539-21sort07:35:012
4116303992212,7cyclictest4167783-21grep09:35:252
4116301992216,3cyclictest0-21swapper/112:18:391
4116301992214,4cyclictest0-21swapper/109:40:251
4116301992212,6cyclictest0-21swapper/110:10:161
4116301992211,7cyclictest4131712-21grep07:50:241
4116297992217,3cyclictest0-21swapper/012:27:090
4116297992216,3cyclictest0-21swapper/007:20:160
4116297992215,5cyclictest121ktimers/012:00:110
4116297992215,4cyclictest4187024-21sshd10:33:170
411629799221,3cyclictest0-21swapper/011:00:470
4116303992115,3cyclictest0-21swapper/207:45:132
4116303992114,4cyclictest0-21swapper/212:15:002
4116301992115,3cyclictest26415-21fschecks_count12:10:151
4116301992113,6cyclictest231ktimers/108:20:061
4116301992113,5cyclictest231ktimers/108:45:011
411629799211,18cyclictest0-21swapper/011:41:500
411630399202,13cyclictest4178287-21sshd10:08:132
4116301992013,4cyclictest1-21systemd09:58:111
4116301991911,5cyclictest231ktimers/111:30:111
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional