You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-05-17 - 10:28

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #b, slot #5

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  Phytec
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.

Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the 792 highest latencies:
System rackbslot5s.osadl.org (updated Sun May 17, 2026 00:44:53)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
398090995036,11cyclictest311ktimers/221:45:122
398081994935,10cyclictest121ktimers/019:45:110
398092994836,9cyclictest391ktimers/322:15:133
398092994834,10cyclictest391ktimers/322:05:113
398081994832,12cyclictest121ktimers/023:00:120
398092994739,5cyclictest458290-21sendmail22:00:013
398092994739,5cyclictest458290-21sendmail22:00:003
398090994737,6cyclictest508839-21cut00:25:192
398090994723,7cyclictest131rcu_preempt22:15:112
398081994639,4cyclictest474054-21cron22:45:010
398081994433,7cyclictest399275-21grep19:10:260
398092994230,10cyclictest391ktimers/323:05:113
398092994229,8cyclictest0-21swapper/300:00:003
39809099421,18cyclictest0-21swapper/222:20:122
39809099421,14cyclictest0-21swapper/221:55:122
39809099421,14cyclictest0-21swapper/221:55:122
398092994130,6cyclictest451253-21wc21:40:003
398090994135,3cyclictest433147-21munin-plugin-st20:50:002
398085994132,5cyclictest460215-21munin-plugin-st22:05:001
398081994131,7cyclictest406677-21grep19:30:390
398092994032,5cyclictest506662-21cron00:20:003
398092994032,5cyclictest506662-21cron00:19:593
398085994033,4cyclictest451038-21munin-run21:40:011
398085994028,8cyclictest454436-21grep21:45:251
398085994027,9cyclictest406727-21grep19:30:381
39809299399,11cyclictest417674-21date20:05:013
39809299399,11cyclictest417674-21date20:05:003
398090993928,8cyclictest472350-21cut22:40:002
398085993930,7cyclictest427830-21kworker/u8:1+events_unbound22:48:121
398081993931,5cyclictest513499-21sendmail00:40:010
398092993831,4cyclictest475770-21munin-plugin-st22:50:013
398090993830,6cyclictest493629-21kworker/u8:3+events_unbound00:18:362
398090993830,6cyclictest493629-21kworker/u8:3+events_unbound00:18:362
398090993828,6cyclictest475335-21grep22:45:232
398090993827,7cyclictest408367-21grep19:35:262
398092993725,8cyclictest472362-21sendmail22:40:003
39809099376,4cyclictest131rcu_preempt22:25:152
398081993730,4cyclictest485995-21munin-plugin-st23:20:000
398081993730,4cyclictest485995-21munin-plugin-st23:20:000
398081993724,8cyclictest402029-21idleruntime-cro19:20:000
398092993627,5cyclictest0-21swapper/320:10:003
398090993628,4cyclictest0-21swapper/220:20:162
398090993626,8cyclictest311ktimers/221:30:122
398090993625,7cyclictest446955-21grep21:25:272
398090993625,7cyclictest0-21swapper/219:30:382
398092993527,4cyclictest429727-21cron20:40:003
398092993526,5cyclictest0-21swapper/321:17:583
398092993524,7cyclictest0-21swapper/319:15:263
398090993524,8cyclictest311ktimers/200:30:122
398085993527,4cyclictest0-21swapper/123:30:251
398085993524,7cyclictest0-21swapper/120:40:261
398081993525,6cyclictest0-21swapper/020:00:240
398081993525,6cyclictest0-21swapper/020:00:240
398081993525,6cyclictest0-21swapper/000:05:010
398092993427,4cyclictest422938-21apt-get20:20:143
398092993426,4cyclictest0-21swapper/321:45:173
398092993423,8cyclictest405680-21apt-get19:30:273
398092993422,8cyclictest463393-21grep22:10:243
398092993421,9cyclictest426300-21sshd20:29:553
398092993419,12cyclictest421215-21apt-get20:15:113
398090993426,4cyclictest0-21swapper/223:00:162
398090993424,7cyclictest451030-21apt-get21:40:002
398090993424,7cyclictest438-21cron22:10:012
39809099341,4cyclictest131rcu_preempt20:35:112
398085993427,5cyclictest463651-21kworker/u8:4+events_unbound22:18:091
398085993427,4cyclictest0-21swapper/100:00:011
398085993426,4cyclictest0-21swapper/123:40:161
398081993427,4cyclictest424418-21munin-plugin-st20:25:020
398081993424,6cyclictest0-21swapper/021:15:260
398092993326,3cyclictest493065-21apt-get23:40:133
398092993325,4cyclictest0-21swapper/323:45:253
398092993323,6cyclictest415431-21head19:55:263
398092993322,8cyclictest513312-21cron00:38:013
39809099331,4cyclictest131rcu_preempt21:15:142
398085993326,4cyclictest462109-21latency_hist22:10:001
398085993322,7cyclictest404958-21grep19:25:261
398085993313,8cyclictest131rcu_preempt19:15:141
398081993318,12cyclictest398075-21cyclictest23:05:100
39809299325,9cyclictest398917-21gzip19:10:243
398092993223,4cyclictest0-21swapper/321:30:003
398092993222,7cyclictest427232-21/usr/sbin/munin20:30:243
398092993220,8cyclictest482817-21apt-get23:10:123
398092993220,8cyclictest482817-21apt-get23:10:113
398092993219,10cyclictest497755-21cron23:53:003
398092993219,10cyclictest490164-21/usr/sbin/munin23:30:203
398092993219,10cyclictest478671-21/usr/sbin/munin22:55:253
398092993219,10cyclictest473042-21/usr/sbin/munin22:40:203
398092993219,10cyclictest466312-21/usr/sbin/munin22:20:213
398092993215,8cyclictest0-21swapper/320:45:123
398092993215,14cyclictest447970-21/usr/sbin/munin21:30:133
398092993215,13cyclictest411542-21tr19:45:203
398090993226,4cyclictest493629-21kworker/u8:3+events_unbound23:53:302
398090993226,3cyclictest0-21swapper/223:15:182
398090993226,3cyclictest0-21swapper/223:15:172
398090993221,7cyclictest0-21swapper/219:25:262
398085993224,4cyclictest0-21swapper/120:20:161
398092993124,4cyclictest440619-21apt-get21:10:133
398092993123,4cyclictest433139-21apt-get20:50:063
398092993123,4cyclictest433139-21apt-get20:50:053
398092993121,7cyclictest507262-21/usr/sbin/munin00:20:173
398092993121,7cyclictest459802-21/usr/sbin/munin22:00:263
398092993121,7cyclictest451030-21apt-get21:40:063
398092993121,7cyclictest435590-21/usr/sbin/munin20:55:183
398092993120,8cyclictest403378-21sshd19:20:553
398092993119,8cyclictest468475-21unixbench_multi22:25:283
398092993119,8cyclictest2868751-1kworker/3:1H+kblockd00:15:003
398092993119,8cyclictest2868751-1kworker/3:1H+kblockd00:15:003
398092993118,10cyclictest487617-21cron23:23:593
398092993117,9cyclictest0-21swapper/323:15:153
398092993117,9cyclictest0-21swapper/323:15:143
398092993115,10cyclictest0-21swapper/323:25:123
398090993125,3cyclictest0-21swapper/221:10:002
398090993125,3cyclictest0-21swapper/200:25:002
398090993121,7cyclictest401543-21grep19:15:262
398081993125,3cyclictest645-21runrttasks22:50:120
398081993123,4cyclictest0-21swapper/022:30:240
398081993123,4cyclictest0-21swapper/022:00:250
398092993023,4cyclictest455103-21apt-get21:50:103
398092993023,4cyclictest455103-21apt-get21:50:103
398092993020,7cyclictest502321-21/usr/sbin/munin00:05:203
398092993020,6cyclictest420479-21sed20:10:233
398092993019,8cyclictest479931-21/usr/sbin/munin23:00:203
398092993017,9cyclictest391ktimers/300:25:133
398092993016,11cyclictest444343-21/usr/sbin/munin21:20:163
398092993012,15cyclictest430210-21idleruntime20:40:163
398092993011,14cyclictest410681-21grep19:45:013
39809099306,4cyclictest131rcu_preempt20:40:252
398090993026,2cyclictest0-21swapper/220:50:112
398090993026,2cyclictest0-21swapper/220:50:102
398090993022,4cyclictest0-21swapper/200:10:252
398090993022,4cyclictest0-21swapper/200:10:242
398090993020,6cyclictest0-21swapper/220:05:272
39808599306,4cyclictest0-21swapper/120:00:121
39808599306,4cyclictest0-21swapper/120:00:121
398085993023,5cyclictest477400-21kworker/u8:0+events_unbound22:56:421
398085993022,4cyclictest0-21swapper/121:50:151
398085993022,4cyclictest0-21swapper/121:50:141
398085993021,5cyclictest0-21swapper/100:19:591
398085993021,5cyclictest0-21swapper/100:19:591
398085993019,8cyclictest231ktimers/100:20:121
398081993024,3cyclictest415888-21sendmail20:00:010
398081993022,5cyclictest0-21swapper/020:45:260
398081993020,7cyclictest419281-21sh20:10:000
398081993020,6cyclictest0-21swapper/023:40:010
398092992923,3cyclictest469170-21apt-get22:30:123
398092992923,3cyclictest437003-21apt-get21:00:133
398092992920,6cyclictest53-21kcompactd019:50:563
398092992919,7cyclictest407811-21meminfo19:35:193
398092992918,8cyclictest500545-21meminfo00:00:183
398092992918,8cyclictest404445-21/usr/sbin/munin19:25:223
398092992915,11cyclictest476471-21/usr/sbin/munin22:50:213
398090992921,3cyclictest0-21swapper/200:05:152
398090992917,9cyclictest478632-21sed22:55:262
398090992916,8cyclictest311ktimers/220:00:132
398090992916,8cyclictest311ktimers/220:00:122
398085992920,5cyclictest0-21swapper/120:45:251
398085992919,6cyclictest0-21swapper/122:25:001
398085992914,8cyclictest131rcu_preempt00:31:231
398081992911,4cyclictest447479-21latency_hist21:30:000
398092992821,4cyclictest0-21swapper/323:35:163
398092992817,8cyclictest510330-21/usr/sbin/munin00:30:143
39809099282,3cyclictest419513-21apt-get20:10:092
398090992821,5cyclictest465362-21kworker/u8:0+events_unbound22:32:422
398090992821,3cyclictest0-21swapper/219:50:162
398085992822,4cyclictest485981-21cron23:20:001
398085992822,4cyclictest485981-21cron23:20:001
398085992822,4cyclictest420616-21kworker/u8:0+events_unbound20:11:431
398085992820,4cyclictest0-21swapper/100:05:241
398085992814,8cyclictest231ktimers/122:35:121
398081992820,6cyclictest121ktimers/021:10:130
398081992817,7cyclictest0-21swapper/021:45:010
398092992714,10cyclictest439690-21sed21:05:263
398090992721,4cyclictest508042-21kworker/u8:2+events_unbound00:38:382
398090992719,4cyclictest0-21swapper/219:20:162
398090992718,7cyclictest482510-21kworker/u8:3+events_unbound23:13:162
398090992718,7cyclictest482510-21kworker/u8:3+events_unbound23:13:162
39808599278,12cyclictest24-21ksoftirqd/122:45:011
398085992721,3cyclictest0-21swapper/121:30:161
398085992721,3cyclictest0-21swapper/119:50:171
398085992720,4cyclictest0-21swapper/100:10:261
398085992720,4cyclictest0-21swapper/100:10:251
398085992719,4cyclictest0-21swapper/122:10:251
398085992717,5cyclictest0-21swapper/122:50:161
398085992716,7cyclictest452523-21grep21:40:251
398081992720,4cyclictest13550irq/42-30be0000.ethernet22:00:010
398081992720,4cyclictest13550irq/42-30be0000.ethernet22:00:000
398081992720,4cyclictest0-21swapper/020:45:010
398081992717,7cyclictest448863-21grep21:30:250
398090992620,4cyclictest427830-21kworker/u8:1+events_unbound23:25:252
398090992620,3cyclictest0-21swapper/223:45:242
398090992620,3cyclictest0-21swapper/221:05:002
398090992619,5cyclictest427830-21kworker/u8:1+events_unbound20:55:202
398090992619,3cyclictest0-21swapper/222:03:042
398090992618,4cyclictest0-21swapper/219:40:272
398090992617,6cyclictest0-21swapper/221:45:012
398090992616,7cyclictest311ktimers/220:15:122
398090992616,6cyclictest399868-21munin-node19:15:022
39808599264,3cyclictest131rcu_preempt21:00:001
398085992620,4cyclictest439546-21timerandwakeup21:05:251
398085992620,4cyclictest397723-21kworker/u8:3+events_unbound19:35:251
398085992618,5cyclictest493629-21kworker/u8:3+events_unbound23:45:221
398085992617,6cyclictest445767-21latency_hist21:25:011
398085992617,4cyclictest0-21swapper/122:00:011
398085992617,4cyclictest0-21swapper/122:00:001
398085992616,6cyclictest470635-21sh22:35:001
398085992616,6cyclictest0-21swapper/120:00:001
39808599261,3cyclictest426550-21apt-get20:30:141
398085992613,7cyclictest510312-21kworker/u8:3+events_unbound00:35:121
398081992618,4cyclictest479166-21sh23:00:000
39809099254,4cyclictest131rcu_preempt21:25:022
398090992519,4cyclictest412091-21kworker/u8:1+events_unbound19:49:142
398090992519,3cyclictest0-21swapper/223:10:002
398090992518,5cyclictest420616-21kworker/u8:0+events_unbound20:27:022
398090992518,3cyclictest0-21swapper/200:00:232
398090992517,4cyclictest0-21swapper/220:30:272
398085992518,4cyclictest489416-21latency_hist23:30:001
398085992515,6cyclictest0-21swapper/121:25:261
39808599251,4cyclictest131rcu_preempt19:20:131
398085992514,8cyclictest434140-21ntp_states20:50:201
398085992514,8cyclictest434140-21ntp_states20:50:201
398081992518,5cyclictest404287-21kworker/u8:1+events_unbound19:27:460
398081992517,5cyclictest0-21swapper/021:50:000
398081992515,7cyclictest436277-21grep20:55:260
39808199251,20cyclictest0-21swapper/022:35:030
39808199251,20cyclictest0-21swapper/022:17:250
39808199251,20cyclictest0-21swapper/020:29:390
398081992510,13cyclictest121ktimers/020:15:150
398090992419,3cyclictest416092-21latency_hist20:00:012
398090992417,4cyclictest4916852sleep223:35:182
39808599245,12cyclictest0-21swapper/123:50:171
398085992418,4cyclictest493629-21kworker/u8:3+events_unbound00:00:341
398085992417,4cyclictest422683-21cron20:20:001
398085992417,4cyclictest0-21swapper/119:10:231
398085992416,5cyclictest0-21swapper/123:10:201
398085992416,5cyclictest0-21swapper/123:10:201
398085992416,4cyclictest0-21swapper/123:40:001
398085992416,4cyclictest0-21swapper/123:05:241
398085992416,4cyclictest0-21swapper/120:40:011
398081992419,3cyclictest13550irq/42-30be0000.ethernet00:05:110
398081992418,3cyclictest0-21swapper/000:35:000
398081992417,4cyclictest13550irq/42-30be0000.ethernet20:10:220
398081992417,3cyclictest0-21swapper/023:55:250
398081992417,3cyclictest0-21swapper/023:21:260
398081992417,3cyclictest0-21swapper/021:09:110
398081992417,3cyclictest0-21swapper/000:28:220
39808199241,21cyclictest0-21swapper/020:53:230
39808199241,21cyclictest0-21swapper/020:53:230
39808199241,19cyclictest0-21swapper/023:32:550
39808199241,19cyclictest0-21swapper/021:02:370
39808199241,19cyclictest0-21swapper/020:33:370
39808199241,19cyclictest0-21swapper/019:50:340
39808199241,10cyclictest444153-21df_inode21:20:140
398090992317,3cyclictest0-21swapper/222:50:242
398090992316,5cyclictest491098-21kworker/u8:1+events_unbound23:42:432
398090992314,6cyclictest498558-21tune2fs23:55:162
398085992317,4cyclictest420616-21kworker/u8:0+events_unbound21:01:371
398085992317,3cyclictest0-21swapper/120:25:251
398085992316,5cyclictest420616-21kworker/u8:0+events_unbound21:17:581
398085992316,3cyclictest0-21swapper/123:00:231
398081992318,3cyclictest398075-21cyclictest22:45:120
398081992318,3cyclictest0-21swapper/019:40:010
398081992317,3cyclictest489415-21kthreadd23:29:590
398081992317,3cyclictest0-21swapper/022:10:000
398081992316,4cyclictest462325-21gdbus22:10:010
398081992313,3cyclictest0-21swapper/000:17:460
398081992313,3cyclictest0-21swapper/000:17:460
39808199231,18cyclictest0-21swapper/020:36:360
39808199231,18cyclictest0-21swapper/019:20:080
39808199230,20cyclictest0-21swapper/023:49:360
39808199230,19cyclictest0-21swapper/022:21:280
398090992216,3cyclictest0-21swapper/222:40:162
398090992214,6cyclictest485723-21kworker/u8:0+events_unbound23:30:022
398090992214,5cyclictest0-21swapper/223:20:162
398085992212,7cyclictest411488-21sed19:45:201
398081992216,3cyclictest0-21swapper/021:35:160
398081992215,5cyclictest0-21swapper/022:25:090
398081992215,3cyclictest0-21swapper/000:20:350
398081992214,5cyclictest0-21swapper/023:10:250
398081992214,5cyclictest0-21swapper/023:10:250
39808199221,19cyclictest0-21swapper/023:54:150
39808199221,19cyclictest0-21swapper/023:42:380
39808199221,19cyclictest0-21swapper/021:51:180
39808199221,19cyclictest0-21swapper/021:51:180
398090992113,4cyclictest0-21swapper/221:50:152
398090992113,4cyclictest0-21swapper/221:50:142
39808599212,3cyclictest131rcu_preempt22:25:181
39808599209,9cyclictest398075-21cyclictest00:25:131
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional