You are here: Home / Projects / OSADL QA Farm Real-time / Latency plots / 
2025-05-03 - 00:06

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #b, slot #5

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  Phytec
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.

Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the highest latencies:
System rackbslot5s.osadl.org (updated Fri May 02, 2025 12:44:53)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
638367994837,8cyclictest655606-21unixbench_multi07:55:291
638363994840,4cyclictest745264-21sendmail12:20:010
638374994536,5cyclictest683466-21sh09:20:013
638374994536,5cyclictest669668-21munin-run08:39:593
638374994435,5cyclictest738456-21munin-plugin-st12:00:003
638370994232,5cyclictest0-21swapper/212:00:012
638363994231,6cyclictest0-21swapper/011:55:000
638374994134,4cyclictest676460-21munin-plugin-st09:00:013
638370994131,6cyclictest708914-21unixbench_multi10:30:302
638370994131,6cyclictest708914-21unixbench_multi10:30:302
638367994127,10cyclictest231ktimers/109:20:121
63836399411,12cyclictest11-21ksoftirqd/007:50:100
638374994033,4cyclictest736301-21unixbench_multi11:50:253
638374994033,4cyclictest679445-21unixbench_singl09:05:263
638374994033,4cyclictest671369-21auditctl08:45:003
638374994031,6cyclictest728431-21fschecks_count11:30:173
638374994031,6cyclictest728431-21fschecks_count11:30:173
638374994030,6cyclictest0-21swapper/309:50:003
638374994030,6cyclictest0-21swapper/309:49:593
638370994031,6cyclictest674346-21unixbench_singl08:50:252
638374993929,6cyclictest0-21swapper/308:30:013
638374993929,6cyclictest0-21swapper/308:30:013
638370993931,5cyclictest751789-21unixbench_multi12:35:282
638370993931,5cyclictest751789-21unixbench_multi12:35:272
638363993927,7cyclictest0-21swapper/012:15:010
638363993918,12cyclictest637-21runrttasks07:56:130
638374993830,5cyclictest652690-21cron07:50:003
638374993827,7cyclictest0-21swapper/309:15:013
638370993828,7cyclictest0-21swapper/210:20:002
638370993828,7cyclictest0-21swapper/210:20:002
63836799385,6cyclictest131rcu_preempt11:05:151
638367993831,4cyclictest683461-21cron09:20:001
638367993830,4cyclictest0-21swapper/110:15:011
638374993728,6cyclictest750097-21unixbench_multi12:30:253
638374993728,6cyclictest750097-21unixbench_multi12:30:243
638367993730,3cyclictest0-21swapper/109:59:591
638367993727,7cyclictest745247-21cron12:20:001
638363993722,5cyclictest131rcu_preempt11:13:500
638363993722,5cyclictest131rcu_preempt10:40:000
638363993718,5cyclictest131rcu_preempt09:10:180
638374993630,4cyclictest702015-21kworker/u8:0+events_unbound10:16:433
638374993630,4cyclictest702015-21kworker/u8:0+events_unbound10:16:423
638374993628,4cyclictest0-21swapper/312:35:193
638374993628,4cyclictest0-21swapper/312:35:193
638370993625,7cyclictest0-21swapper/207:25:012
638367993628,4cyclictest722957-21kthreadd11:15:001
638367993626,6cyclictest0-21swapper/107:40:001
638367993528,4cyclictest752275-21idleruntime-cro12:39:591
638367993528,4cyclictest752275-21idleruntime-cro12:39:591
638367993528,4cyclictest0-21swapper/108:55:001
638367993527,4cyclictest0-21swapper/110:40:201
638363993525,5cyclictest0-21swapper/012:00:250
638363993522,8cyclictest0-21swapper/008:55:280
638363993521,5cyclictest131rcu_preempt08:42:400
638374993425,5cyclictest0-21swapper/310:20:273
638374993424,6cyclictest0-21swapper/312:15:013
638374993424,6cyclictest0-21swapper/311:40:283
638374993422,7cyclictest0-21swapper/308:00:273
638370993425,5cyclictest0-21swapper/210:10:012
638370993418,6cyclictest749570-21missed_timers12:30:202
638370993418,6cyclictest749570-21missed_timers12:30:192
63837099340,5cyclictest131rcu_preempt10:50:142
63836799347,4cyclictest131rcu_preempt07:15:131
638367993422,8cyclictest0-21swapper/109:15:011
638367993418,13cyclictest0-21swapper/109:40:001
63836399346,21cyclictest11-21ksoftirqd/008:20:300
638363993425,5cyclictest0-21swapper/010:00:000
638363993423,7cyclictest0-21swapper/011:40:010
638363993423,5cyclictest131rcu_preempt11:58:260
638363993422,4cyclictest131rcu_preempt09:02:370
638363993415,3cyclictest0-21swapper/011:29:550
63837499336,5cyclictest131rcu_preempt12:25:143
63837499336,4cyclictest131rcu_preempt10:00:153
63837499334,5cyclictest131rcu_preempt09:20:133
638374993326,4cyclictest638354-21cyclictest12:20:013
638370993327,3cyclictest690261-21kthreadd09:39:592
638370993323,7cyclictest701911-21unixbench_multi10:10:272
638367993325,5cyclictest669664-21auditctl08:40:001
638367993325,4cyclictest0-21swapper/108:00:251
638363993327,4cyclictest649082-21kworker/u8:0-events_power_efficient07:48:410
638363993324,5cyclictest0-21swapper/010:25:270
638363993324,5cyclictest0-21swapper/010:25:260
638363993323,7cyclictest686415-21grep09:25:260
638363993322,7cyclictest712304-21grep10:40:290
638363993321,7cyclictest121ktimers/008:25:290
638363993321,7cyclictest121ktimers/008:25:290
638363993321,4cyclictest131rcu_preempt10:05:210
638363993319,9cyclictest679397-21grep09:05:260
638363993319,5cyclictest131rcu_preempt12:30:000
638363993317,5cyclictest705545-21kworker/u8:1-events_freezable_power_10:33:290
638363993317,5cyclictest705545-21kworker/u8:1-events_freezable_power_10:33:280
638363993317,5cyclictest131rcu_preempt10:14:060
638363993317,3cyclictest131rcu_preempt09:46:440
638363993317,3cyclictest131rcu_preempt09:46:440
638363993316,4cyclictest131rcu_preempt09:15:230
638363993314,5cyclictest131rcu_preempt07:10:180
638374993225,4cyclictest0-21swapper/307:25:293
638374993225,3cyclictest0-21swapper/308:45:253
638374993224,4cyclictest0-21swapper/310:55:283
638374993223,6cyclictest0-21swapper/311:20:233
638374993222,6cyclictest0-21swapper/312:20:253
638374993222,6cyclictest0-21swapper/310:25:273
638374993222,6cyclictest0-21swapper/310:25:273
638374993222,6cyclictest0-21swapper/308:35:003
63837099327,4cyclictest0-21swapper/210:25:132
63837099327,4cyclictest0-21swapper/210:25:132
638370993225,5cyclictest311ktimers/210:35:142
638370993224,4cyclictest0-21swapper/209:05:272
638370993222,6cyclictest0-21swapper/212:05:012
63837099321,9cyclictest0-21swapper/207:35:162
63837099321,5cyclictest0-21swapper/208:45:122
63836799327,4cyclictest131rcu_preempt09:00:161
638367993222,6cyclictest0-21swapper/107:35:001
638367993218,6cyclictest654245-21kworker/u8:1+events_unbound08:13:451
63836399329,13cyclictest11-21ksoftirqd/010:55:010
63836399328,3cyclictest131rcu_preempt07:41:500
63836399322,26cyclictest151rcuc/010:55:130
638363993221,7cyclictest121ktimers/012:20:240
638363993220,7cyclictest0-21swapper/010:00:300
638363993219,5cyclictest131rcu_preempt10:45:170
638363993214,4cyclictest131rcu_preempt07:32:550
638363993214,3cyclictest131rcu_preempt08:53:460
638363993212,10cyclictest0-21swapper/007:23:050
638363993211,13cyclictest11-21ksoftirqd/012:30:020
638363993211,13cyclictest11-21ksoftirqd/012:30:020
638374993122,6cyclictest0-21swapper/309:55:213
638374993122,6cyclictest0-21swapper/309:45:013
638374993122,4cyclictest0-21swapper/308:10:183
638374993120,7cyclictest0-21swapper/311:00:253
638370993123,5cyclictest0-21swapper/209:20:172
638370993120,5cyclictest662523-21kworker/u8:2+events_unbound08:20:022
638367993124,4cyclictest0-21swapper/111:15:261
638367993121,7cyclictest731042-21unixbench_singl11:35:271
638367993121,6cyclictest0-21swapper/110:30:271
638367993121,6cyclictest0-21swapper/110:30:271
638367993120,7cyclictest0-21swapper/108:30:251
638363993122,7cyclictest739922-21kworker/u8:1+events_unbound12:07:420
638363993118,5cyclictest131rcu_preempt11:20:500
638363993118,4cyclictest131rcu_preempt08:15:390
638363993117,3cyclictest131rcu_preempt11:08:000
638363993115,5cyclictest131rcu_preempt10:20:470
638363993114,5cyclictest131rcu_preempt07:30:020
638363993113,11cyclictest131rcu_preempt11:40:210
638363993112,11cyclictest131rcu_preempt08:30:250
638374993020,6cyclictest0-21swapper/311:10:453
638374993020,6cyclictest0-21swapper/310:50:283
638374993018,9cyclictest391ktimers/310:10:133
638374993018,7cyclictest0-21swapper/310:35:283
638370993024,3cyclictest0-21swapper/208:15:012
638370993023,4cyclictest0-21swapper/211:35:262
638370993023,4cyclictest0-21swapper/207:45:302
638370993019,7cyclictest0-21swapper/208:35:192
638370993015,4cyclictest0-21swapper/208:20:252
638367993024,4cyclictest728046-21kworker/u8:1+events_unbound11:33:451
638367993024,4cyclictest728046-21kworker/u8:1+events_unbound11:33:451
638367993024,3cyclictest0-21swapper/108:05:191
638367993022,4cyclictest0-21swapper/111:55:271
638367993022,4cyclictest0-21swapper/107:40:251
638367993014,10cyclictest662523-21kworker/u8:2+events_unbound08:49:501
63836399309,10cyclictest11-21ksoftirqd/011:50:010
638363993021,6cyclictest0-21swapper/008:39:590
638363993019,4cyclictest131rcu_preempt07:15:230
638363993018,5cyclictest131rcu_preempt09:50:270
638363993018,5cyclictest131rcu_preempt09:50:260
638363993016,5cyclictest131rcu_preempt09:30:300
638363993016,5cyclictest131rcu_preempt09:30:290
638363993016,4cyclictest131rcu_preempt09:23:150
638363993012,5cyclictest131rcu_preempt08:10:150
638363993012,3cyclictest0-21swapper/008:07:140
638363993011,10cyclictest131rcu_preempt07:35:060
638374992921,4cyclictest0-21swapper/311:40:003
638374992919,6cyclictest708911-21grep10:30:293
638374992919,6cyclictest708911-21grep10:30:293
638374992919,6cyclictest674343-21grep08:50:253
638374992918,7cyclictest0-21swapper/307:15:253
63837099297,8cyclictest131rcu_preempt12:05:132
63837099297,8cyclictest131rcu_preempt09:55:002
63837099297,8cyclictest131rcu_preempt09:54:592
63837099296,20cyclictest666377-21grep08:30:012
63837099296,20cyclictest666377-21grep08:30:002
63837099294,4cyclictest131rcu_preempt09:00:162
638370992923,4cyclictest722878-21kworker/u8:2+events_unbound11:28:582
638370992923,4cyclictest649082-21kworker/u8:0+events_unbound07:52:432
638370992922,4cyclictest0-21swapper/209:15:252
638370992919,6cyclictest0-21swapper/211:00:262
638370992918,7cyclictest0-21swapper/207:55:282
63836799298,7cyclictest131rcu_preempt12:00:161
63836799297,12cyclictest131rcu_preempt07:25:011
638367992921,5cyclictest666282-21munin-plugin-st08:30:011
638367992921,5cyclictest666282-21munin-plugin-st08:30:001
638367992915,4cyclictest698915-21kworker/u8:2+events_unbound10:09:391
63836799291,17cyclictest0-21swapper/110:53:251
63836399294,6cyclictest11-21ksoftirqd/009:35:180
638363992923,4cyclictest702015-21kworker/u8:0+events_unbound10:18:340
638363992923,4cyclictest702015-21kworker/u8:0+events_unbound10:18:340
638363992915,5cyclictest131rcu_preempt08:45:150
638363992914,6cyclictest131rcu_preempt11:20:000
638363992912,4cyclictest131rcu_preempt08:00:210
638363992911,11cyclictest11-21ksoftirqd/011:30:210
638363992911,11cyclictest11-21ksoftirqd/011:30:200
638374992817,7cyclictest0-21swapper/309:35:003
638374992817,7cyclictest0-21swapper/309:34:593
63837099287,8cyclictest131rcu_preempt08:30:262
638370992822,4cyclictest680095-21kworker/u8:2+events_unbound09:25:442
638370992821,4cyclictest0-21swapper/208:00:272
638370992820,5cyclictest717863-21cat11:00:002
638370992815,11cyclictest32-21ksoftirqd/212:30:012
63836799286,12cyclictest131rcu_preempt10:25:151
63836799286,12cyclictest131rcu_preempt10:25:141
638367992821,3cyclictest0-21swapper/110:50:001
63836399289,9cyclictest0-21swapper/012:36:410
63836399289,9cyclictest0-21swapper/012:36:410
63836399289,4cyclictest131rcu_preempt11:03:250
638374992721,4cyclictest712544-21kworker/u8:1+events_unbound10:42:443
638374992721,3cyclictest0-21swapper/307:10:283
638374992720,4cyclictest0-21swapper/307:20:253
638374992719,5cyclictest0-21swapper/310:45:173
638374992717,6cyclictest0-21swapper/307:55:293
638370992721,4cyclictest657709-21kworker/u8:2+events_unbound08:05:312
638370992720,5cyclictest731379-21kworker/u8:1+events_unbound11:51:312
638370992718,6cyclictest696012-21tune2fs09:55:202
638370992717,6cyclictest0-21swapper/207:15:262
638370992716,7cyclictest0-21swapper/207:35:002
638370992714,7cyclictest32-21ksoftirqd/212:25:012
638370992713,10cyclictest32-21ksoftirqd/209:45:292
638370992713,10cyclictest32-21ksoftirqd/209:45:292
63837099271,12cyclictest0-21swapper/211:30:212
63837099271,12cyclictest0-21swapper/211:30:202
63836799277,8cyclictest131rcu_preempt10:20:171
63836799277,11cyclictest131rcu_preempt09:05:261
63836799276,13cyclictest131rcu_preempt08:58:381
63836799275,5cyclictest131rcu_preempt09:40:141
63836799274,5cyclictest131rcu_preempt11:45:111
63836799273,4cyclictest131rcu_preempt09:30:171
63836799273,4cyclictest131rcu_preempt09:30:171
638367992718,6cyclictest0-21swapper/111:05:001
638374992618,4cyclictest0-21swapper/312:00:163
638374992617,5cyclictest0-21swapper/307:50:223
638370992619,4cyclictest698915-21kworker/u8:2+events_unbound10:24:512
638370992619,3cyclictest0-21swapper/207:25:212
638370992614,9cyclictest32-21ksoftirqd/207:40:212
63836799269,7cyclictest131rcu_preempt11:25:261
63836799266,11cyclictest131rcu_preempt12:20:261
63836799265,12cyclictest131rcu_preempt07:25:281
63836799265,11cyclictest131rcu_preempt07:50:151
638367992620,4cyclictest739922-21kworker/u8:1+events_unbound12:05:031
638367992618,5cyclictest0-21swapper/108:15:261
638367992615,6cyclictest0-21swapper/111:40:271
638374992517,5cyclictest0-21swapper/307:40:253
638374992517,4cyclictest0-21swapper/311:15:173
638374992516,4cyclictest0-21swapper/312:05:243
638370992519,4cyclictest710817-21kworker/u8:0+events_unbound11:11:522
63836799259,8cyclictest131rcu_preempt11:50:341
63836799259,7cyclictest131rcu_preempt07:45:251
63836799259,6cyclictest131rcu_preempt10:35:221
63836799258,9cyclictest131rcu_preempt10:00:271
63836799255,12cyclictest131rcu_preempt12:10:231
63836799254,4cyclictest131rcu_preempt08:40:161
638367992518,3cyclictest0-21swapper/109:50:241
638367992518,3cyclictest0-21swapper/109:50:241
63836799251,5cyclictest131rcu_preempt09:45:171
63836799251,5cyclictest131rcu_preempt09:45:161
638367992514,8cyclictest685477-21cat09:25:151
638367992511,11cyclictest24-21ksoftirqd/110:15:281
638367992511,11cyclictest24-21ksoftirqd/110:15:281
638374992417,3cyclictest0-21swapper/308:05:223
638374992416,4cyclictest0-21swapper/311:25:193
63837099246,8cyclictest131rcu_preempt11:45:232
63837099244,8cyclictest131rcu_preempt09:30:292
63837099244,8cyclictest131rcu_preempt09:30:282
638370992418,4cyclictest731379-21kworker/u8:1+events_unbound11:42:282
638370992418,3cyclictest0-21swapper/212:15:152
638370992417,5cyclictest0-21swapper/209:10:262
638370992415,7cyclictest712121-21switchtime10:40:272
638370992412,10cyclictest32-21ksoftirqd/211:05:172
63837099241,12cyclictest0-21swapper/207:10:062
638370992410,3cyclictest6976342sleep210:00:182
63836799248,6cyclictest639289-21kworker/u8:2+events_unbound07:13:201
63836799245,10cyclictest131rcu_preempt11:20:081
638367992418,3cyclictest0-21swapper/112:30:191
638367992418,3cyclictest0-21swapper/112:30:191
63837499236,10cyclictest662523-21kworker/u8:2+events_unbound08:21:123
638374992317,3cyclictest0-21swapper/309:35:163
638374992317,3cyclictest0-21swapper/307:35:273
638374992315,5cyclictest0-21swapper/309:00:273
638374992315,5cyclictest0-21swapper/308:15:263
638374992315,4cyclictest0-21swapper/309:25:173
63837099234,9cyclictest131rcu_preempt09:00:012
638370992317,4cyclictest687099-21kworker/u8:3+events_unbound09:43:482
638370992317,4cyclictest669636-21kworker/u8:0+events_unbound08:44:512
638370992311,10cyclictest32-21ksoftirqd/212:10:152
63836799238,3cyclictest131rcu_preempt12:25:191
638367992317,3cyclictest0-21swapper/108:20:201
638374992216,4cyclictest698915-21kworker/u8:2+events_unbound10:09:543
638374992216,3cyclictest0-21swapper/311:05:163
638374992213,6cyclictest0-21swapper/309:50:263
638374992213,6cyclictest0-21swapper/309:50:253
638374992213,6cyclictest0-21swapper/307:30:263
638370992213,6cyclictest0-21swapper/211:15:262
63837099216,9cyclictest32-21ksoftirqd/211:20:442
638370992114,4cyclictest311ktimers/210:47:012
638374992011,6cyclictest0-21swapper/311:45:123
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional