You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2025-12-08 - 19:58

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #c, slot #7

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the highest latencies:
System rackcslot7s.osadl.org (updated Mon Dec 08, 2025 12:44:57)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
307311621130,4sleep10-21swapper/107:10:231
307311621130,4sleep10-21swapper/107:10:221
307195728240,14sleep00-21swapper/007:06:320
307219627548,17sleep10-21swapper/107:09:381
162399750,5rtkit-daemon2197014-21PK-Backend10:02:373
162399750,5rtkit-daemon2197014-21PK-Backend10:02:373
162399750,10rtkit-daemon1785-21gmain10:11:313
307211327253,13sleep20-21swapper/207:08:362
162399710,8rtkit-daemon854-21avahi-daemon09:48:463
307194527047,15sleep30-21swapper/307:06:233
162399690,4rtkit-daemon0-21swapper/308:46:523
3072355996817,18cyclictest34-21ksoftirqd/210:25:032
3072355996817,18cyclictest34-21ksoftirqd/210:25:022
3072349996422,8cyclictest13-21ksoftirqd/009:25:130
307235799630,58cyclictest1622-21rtkit-daemon07:35:093
3072355996318,18cyclictest34-21ksoftirqd/208:00:002
162399630,8rtkit-daemon1622-21rtkit-daemon09:58:182
3072355996223,20cyclictest34-21ksoftirqd/208:05:002
307234999622,20cyclictest13-21ksoftirqd/010:25:010
307234999622,20cyclictest13-21ksoftirqd/010:25:010
3072355995922,7cyclictest34-21ksoftirqd/211:07:152
3072355995820,19cyclictest34-21ksoftirqd/212:30:012
3072355995816,19cyclictest34-21ksoftirqd/210:15:012
3072349995846,8cyclictest161rcuc/010:58:490
307234999581,8cyclictest3139048-21rt-features10:15:320
162399580,8rtkit-daemon1622-21rtkit-daemon07:34:313
162399580,8rtkit-daemon1622-21rtkit-daemon07:34:313
162399580,12rtkit-daemon1753-21gnome-shell09:26:091
3072357995721,6cyclictest42-21ksoftirqd/311:55:013
307235799570,54cyclictest1622-21rtkit-daemon07:23:323
3072355995719,17cyclictest34-21ksoftirqd/210:55:012
3072355995712,19cyclictest34-21ksoftirqd/207:35:012
3072355995712,19cyclictest34-21ksoftirqd/207:35:012
307234999575,8cyclictest13-21ksoftirqd/011:35:150
3072349995726,11cyclictest13-21ksoftirqd/009:10:210
3072349995724,10cyclictest13-21ksoftirqd/011:27:170
162399570,8rtkit-daemon1622-21rtkit-daemon07:13:442
162399570,8rtkit-daemon1622-21rtkit-daemon07:13:442
31688512560,18sleep342-21ksoftirqd/311:40:313
3072355995622,17cyclictest34-21ksoftirqd/211:35:152
3072355995618,22cyclictest34-21ksoftirqd/210:20:012
3072355995618,18cyclictest34-21ksoftirqd/209:40:012
3072355995614,20cyclictest34-21ksoftirqd/208:10:012
162399560,9rtkit-daemon1622-21rtkit-daemon10:42:422
3072355995517,18cyclictest34-21ksoftirqd/209:30:002
3072355995511,22cyclictest34-21ksoftirqd/212:15:002
307234999557,19cyclictest13-21ksoftirqd/007:20:030
307234999554,20cyclictest13-21ksoftirqd/008:45:170
3072349995514,10cyclictest13-21ksoftirqd/007:30:160
3072349995514,10cyclictest13-21ksoftirqd/007:30:160
307235799540,48cyclictest1622-21rtkit-daemon11:00:093
307235599549,13cyclictest34-21ksoftirqd/210:10:012
307235599545,8cyclictest34-21ksoftirqd/209:50:012
3072355995422,13cyclictest1753-21gnome-shell10:30:172
3072355995416,18cyclictest34-21ksoftirqd/210:50:012
3072355995412,20cyclictest34-21ksoftirqd/207:30:012
162399540,8rtkit-daemon1622-21rtkit-daemon09:01:192
3072357995329,10cyclictest42-21ksoftirqd/310:10:013
3072355995316,18cyclictest34-21ksoftirqd/207:20:022
3072355995314,17cyclictest34-21ksoftirqd/212:10:012
3072352995328,8cyclictest1753-21gnome-shell09:36:181
3072349995330,8cyclictest13-21ksoftirqd/008:40:230
3072349995318,8cyclictest13-21ksoftirqd/008:25:020
31167282520,6chrt0-21swapper/009:15:020
307235599522,7cyclictest1753-21gnome-shell08:45:112
307235599521,11cyclictest3181532-21chrt12:19:432
3072352995223,14cyclictest26-21ksoftirqd/108:12:581
3072352995214,17cyclictest26-21ksoftirqd/112:10:151
307234999526,20cyclictest13-21ksoftirqd/009:55:480
307234999526,19cyclictest13-21ksoftirqd/010:35:300
3072349995222,9cyclictest13-21ksoftirqd/008:11:480
307234999522,20cyclictest13-21ksoftirqd/011:55:180
3072349995221,6cyclictest141rcu_preempt11:50:290
162399520,8rtkit-daemon1622-21rtkit-daemon10:59:543
162399520,10rtkit-daemon1753-21gnome-shell11:16:210
3072357995131,11cyclictest42-21ksoftirqd/312:05:313
3072355995131,7cyclictest34-21ksoftirqd/207:44:552
3072355995119,16cyclictest34-21ksoftirqd/209:21:222
3072355995114,19cyclictest34-21ksoftirqd/209:15:022
3072355995113,17cyclictest34-21ksoftirqd/209:30:212
3072355995113,17cyclictest34-21ksoftirqd/209:30:212
307234999513,18cyclictest13-21ksoftirqd/012:15:160
307234999511,17cyclictest13-21ksoftirqd/007:50:400
307234999511,17cyclictest13-21ksoftirqd/007:50:400
307235799507,19cyclictest42-21ksoftirqd/311:55:313
3072355995019,9cyclictest34-21ksoftirqd/211:45:022
3072355995015,17cyclictest34-21ksoftirqd/208:30:012
307235599501,29cyclictest854-21avahi-daemon08:42:462
3072352995011,6cyclictest141rcu_preempt07:35:191
307234999508,19cyclictest13-21ksoftirqd/008:00:190
307234999504,8cyclictest13-21ksoftirqd/009:25:010
307234999504,10cyclictest13-21ksoftirqd/012:30:260
3072349995039,7cyclictest161rcuc/009:35:020
3072349995013,18cyclictest13-21ksoftirqd/008:20:000
307234999501,16cyclictest3110225-21forks08:55:190
307234999501,16cyclictest3110225-21forks08:55:190
30788612490,7chrt0-21swapper/107:25:151
3072357994931,5cyclictest42-21ksoftirqd/311:45:233
3072357994919,25cyclictest42-21ksoftirqd/311:10:263
307235599499,16cyclictest2197014-21PK-Backend07:50:042
307235599499,16cyclictest2197014-21PK-Backend07:50:042
307235599498,13cyclictest34-21ksoftirqd/212:05:002
3072355994918,10cyclictest34-21ksoftirqd/210:58:352
3072355994917,11cyclictest1753-21gnome-shell10:00:142
3072355994917,11cyclictest1753-21gnome-shell10:00:142
3072355994913,13cyclictest34-21ksoftirqd/210:30:012
3072355994913,13cyclictest34-21ksoftirqd/210:30:012
3072355994912,19cyclictest34-21ksoftirqd/208:15:022
3072352994922,23cyclictest26-21ksoftirqd/110:09:471
3072352994921,6cyclictest26-21ksoftirqd/112:20:251
3072352994921,6cyclictest26-21ksoftirqd/111:40:181
3072352994918,13cyclictest26-21ksoftirqd/108:25:281
307234999495,21cyclictest13-21ksoftirqd/009:50:260
307234999492,20cyclictest13-21ksoftirqd/008:30:030
307234999491,21cyclictest13-21ksoftirqd/010:10:260
3072349994912,16cyclictest1753-21gnome-shell10:05:290
307234999491,12cyclictest13-21ksoftirqd/011:05:010
3072357994823,21cyclictest42-21ksoftirqd/308:11:563
3072357994822,5cyclictest42-21ksoftirqd/308:30:343
3072357994821,23cyclictest42-21ksoftirqd/307:15:193
3072357994821,22cyclictest42-21ksoftirqd/307:40:173
3072357994811,17cyclictest42-21ksoftirqd/310:00:013
307235599488,16cyclictest34-21ksoftirqd/212:30:192
307235599487,16cyclictest34-21ksoftirqd/211:19:212
3072355994818,8cyclictest1753-21gnome-shell08:55:532
3072355994818,8cyclictest1753-21gnome-shell08:55:522
3072355994816,8cyclictest34-21ksoftirqd/211:55:442
307235599481,28cyclictest3162272-21chrt11:22:152
3072352994824,11cyclictest26-21ksoftirqd/109:45:341
3072352994821,23cyclictest26-21ksoftirqd/108:00:021
3072352994811,10cyclictest3173448-21ls11:55:171
307234999489,11cyclictest141rcu_preempt09:36:180
307234999488,21cyclictest13-21ksoftirqd/009:05:260
307234999488,20cyclictest13-21ksoftirqd/012:35:290
307234999488,20cyclictest13-21ksoftirqd/012:35:290
307234999483,22cyclictest13-21ksoftirqd/008:05:200
307234999483,22cyclictest13-21ksoftirqd/007:40:160
3072349994818,9cyclictest13-21ksoftirqd/009:46:430
3072349994815,10cyclictest13-21ksoftirqd/010:00:320
3072349994815,10cyclictest13-21ksoftirqd/010:00:320
307234999481,18cyclictest2197014-21PK-Backend10:50:150
307234999481,14cyclictest13-21ksoftirqd/007:50:000
3072349994811,15cyclictest141rcu_preempt10:25:200
3072349994811,15cyclictest141rcu_preempt10:25:200
307235799477,15cyclictest141rcu_preempt07:30:003
3072357994736,6cyclictest42-21ksoftirqd/309:15:173
307235599479,19cyclictest34-21ksoftirqd/211:50:142
307235599478,18cyclictest34-21ksoftirqd/211:30:202
307235599478,18cyclictest34-21ksoftirqd/211:10:172
307235599478,17cyclictest34-21ksoftirqd/209:40:322
3072355994719,8cyclictest1753-21gnome-shell11:27:262
3072355994717,8cyclictest1753-21gnome-shell11:48:302
3072355994713,17cyclictest34-21ksoftirqd/207:40:022
307235599471,18cyclictest3145395-21chrt10:35:022
3072355994710,21cyclictest34-21ksoftirqd/207:20:212
307235299478,24cyclictest26-21ksoftirqd/111:10:281
307235299477,21cyclictest26-21ksoftirqd/111:17:261
3072352994717,8cyclictest26-21ksoftirqd/107:20:021
3072352994714,15cyclictest26-21ksoftirqd/111:30:251
3072352994714,15cyclictest1753-21gnome-shell07:50:301
3072352994714,15cyclictest1753-21gnome-shell07:50:291
307235299471,29cyclictest3133573-21memory10:00:231
307235299471,29cyclictest3133573-21memory10:00:231
3072352994711,8cyclictest26-21ksoftirqd/108:05:311
3072352994710,18cyclictest26-21ksoftirqd/109:05:231
3072352994710,18cyclictest26-21ksoftirqd/109:05:011
3072352994710,15cyclictest26-21ksoftirqd/107:21:211
307234999476,21cyclictest13-21ksoftirqd/012:00:120
307234999475,22cyclictest13-21ksoftirqd/009:43:390
307234999475,14cyclictest0-21swapper/009:30:300
3072349994723,7cyclictest13-21ksoftirqd/012:25:180
3072349994716,9cyclictest13-21ksoftirqd/012:11:110
3072349994716,9cyclictest13-21ksoftirqd/011:20:190
307234999471,10cyclictest1753-21gnome-shell12:20:170
3072357994630,12cyclictest42-21ksoftirqd/308:55:033
3072357994628,6cyclictest42-21ksoftirqd/310:45:253
3072357994627,14cyclictest42-21ksoftirqd/312:25:173
3072357994624,14cyclictest42-21ksoftirqd/311:16:393
3072357994623,14cyclictest42-21ksoftirqd/308:20:253
3072357994621,15cyclictest42-21ksoftirqd/312:25:003
3072357994620,9cyclictest42-21ksoftirqd/310:20:013
307235599467,11cyclictest34-21ksoftirqd/211:00:252
3072355994618,6cyclictest141rcu_preempt09:17:212
3072355994617,7cyclictest1753-21gnome-shell09:06:122
307235599461,26cyclictest1753-21gnome-shell07:46:392
307235299469,16cyclictest26-21ksoftirqd/108:55:301
307235299469,16cyclictest26-21ksoftirqd/108:55:301
3072352994628,14cyclictest26-21ksoftirqd/112:05:191
3072352994622,11cyclictest26-21ksoftirqd/110:35:581
3072352994619,14cyclictest26-21ksoftirqd/109:50:241
3072352994610,17cyclictest26-21ksoftirqd/110:41:191
307234999466,19cyclictest13-21ksoftirqd/007:25:280
307234999465,21cyclictest13-21ksoftirqd/011:30:230
3072349994619,9cyclictest13-21ksoftirqd/012:05:400
3072349994619,9cyclictest13-21ksoftirqd/011:45:250
3072349994611,10cyclictest13-21ksoftirqd/007:10:150
3072349994611,10cyclictest13-21ksoftirqd/007:10:150
3072357994529,12cyclictest42-21ksoftirqd/309:35:033
3072357994525,15cyclictest42-21ksoftirqd/312:30:223
3072357994524,8cyclictest141rcu_preempt09:30:013
3072357994523,13cyclictest42-21ksoftirqd/310:43:253
3072357994522,14cyclictest42-21ksoftirqd/309:05:003
3072357994521,15cyclictest42-21ksoftirqd/311:40:023
3072357994520,21cyclictest42-21ksoftirqd/308:15:323
307235599459,17cyclictest1753-21gnome-shell08:53:012
307235599457,20cyclictest34-21ksoftirqd/208:30:212
307235599457,17cyclictest1753-21gnome-shell09:52:242
307235599454,22cyclictest34-21ksoftirqd/208:15:352
3072355994516,7cyclictest1753-21gnome-shell12:23:072
3072355994511,17cyclictest34-21ksoftirqd/208:25:002
307235299457,19cyclictest26-21ksoftirqd/110:45:161
307235299457,16cyclictest26-21ksoftirqd/110:32:391
307235299457,16cyclictest26-21ksoftirqd/108:20:171
307235299457,12cyclictest141rcu_preempt11:50:021
307235299456,8cyclictest26-21ksoftirqd/111:20:201
3072352994521,5cyclictest3107846-21perf08:50:001
3072352994518,13cyclictest26-21ksoftirqd/110:10:171
3072352994517,9cyclictest26-21ksoftirqd/112:00:171
3072352994517,15cyclictest26-21ksoftirqd/108:37:471
3072352994516,8cyclictest26-21ksoftirqd/112:30:151
3072352994514,15cyclictest141rcu_preempt08:00:231
307235299451,22cyclictest26-21ksoftirqd/107:50:001
3072352994510,16cyclictest26-21ksoftirqd/109:42:191
3072352994510,16cyclictest26-21ksoftirqd/108:17:001
307234999458,17cyclictest13-21ksoftirqd/007:55:250
307234999453,19cyclictest13-21ksoftirqd/007:20:040
307234999452,21cyclictest13-21ksoftirqd/010:40:180
3072349994521,9cyclictest13-21ksoftirqd/010:30:150
307234999451,39cyclictest1753-21gnome-shell09:02:590
3072349994512,16cyclictest141rcu_preempt10:48:180
307234999451,13cyclictest13-21ksoftirqd/007:35:270
307234999451,10cyclictest1753-21gnome-shell08:30:260
3072357994426,14cyclictest42-21ksoftirqd/311:30:243
3072357994426,14cyclictest42-21ksoftirqd/309:50:213
3072357994426,13cyclictest42-21ksoftirqd/310:25:283
3072357994426,13cyclictest42-21ksoftirqd/310:25:283
3072357994425,6cyclictest42-21ksoftirqd/312:10:153
3072357994425,6cyclictest42-21ksoftirqd/309:40:123
3072357994425,14cyclictest42-21ksoftirqd/310:35:283
3072357994424,6cyclictest42-21ksoftirqd/312:00:283
3072357994423,13cyclictest42-21ksoftirqd/312:15:143
3072357994423,13cyclictest42-21ksoftirqd/309:05:143
3072357994422,17cyclictest42-21ksoftirqd/310:25:013
3072357994422,17cyclictest42-21ksoftirqd/310:25:013
3072357994421,15cyclictest42-21ksoftirqd/307:10:213
3072357994421,15cyclictest42-21ksoftirqd/307:10:213
3072357994414,13cyclictest141rcu_preempt08:05:023
307235799441,23cyclictest3088534-21taskset07:52:183
307235799441,23cyclictest3088534-21taskset07:52:183
307235799441,22cyclictest3110319-21seq08:55:223
307235799441,22cyclictest3110319-21seq08:55:223
307235599447,16cyclictest34-21ksoftirqd/212:36:062
307235599447,16cyclictest34-21ksoftirqd/212:36:062
307235299449,18cyclictest26-21ksoftirqd/107:30:161
307235299449,18cyclictest26-21ksoftirqd/107:30:161
307235299448,17cyclictest26-21ksoftirqd/108:42:461
307235299448,15cyclictest26-21ksoftirqd/112:16:301
307235299446,16cyclictest26-21ksoftirqd/110:20:211
307235299446,16cyclictest26-21ksoftirqd/110:20:211
3072352994415,12cyclictest26-21ksoftirqd/109:25:011
3072352994411,15cyclictest26-21ksoftirqd/108:54:571
3072352994410,17cyclictest26-21ksoftirqd/110:15:301
307234999446,17cyclictest13-21ksoftirqd/008:35:300
307234999442,20cyclictest13-21ksoftirqd/011:10:010
307234999442,20cyclictest13-21ksoftirqd/008:50:200
307234999441,14cyclictest13-21ksoftirqd/011:10:310
3072357994325,13cyclictest42-21ksoftirqd/307:55:383
3072357994324,14cyclictest42-21ksoftirqd/309:20:323
3072357994324,14cyclictest42-21ksoftirqd/308:40:143
3072357994323,16cyclictest42-21ksoftirqd/307:45:153
3072357994320,14cyclictest42-21ksoftirqd/309:35:003
3072357994320,14cyclictest42-21ksoftirqd/309:35:003
3072357994314,15cyclictest0-21swapper/308:37:343
307235299438,18cyclictest26-21ksoftirqd/111:25:211
307235299438,17cyclictest26-21ksoftirqd/112:39:391
307235299438,17cyclictest26-21ksoftirqd/112:39:391
307235299438,17cyclictest26-21ksoftirqd/108:32:281
307235299435,16cyclictest26-21ksoftirqd/109:10:281
3072352994326,14cyclictest26-21ksoftirqd/111:03:441
3072352994322,13cyclictest26-21ksoftirqd/111:35:151
3072352994313,15cyclictest26-21ksoftirqd/111:45:171
307235799423,16cyclictest42-21ksoftirqd/310:50:313
3072357994225,6cyclictest42-21ksoftirqd/309:10:283
3072357994224,6cyclictest42-21ksoftirqd/311:05:323
3072357994224,14cyclictest42-21ksoftirqd/311:25:123
3072357994224,14cyclictest42-21ksoftirqd/311:20:053
3072357994224,13cyclictest42-21ksoftirqd/308:25:193
3072357994223,14cyclictest42-21ksoftirqd/310:30:293
3072357994221,13cyclictest42-21ksoftirqd/308:06:343
307235599424,17cyclictest1753-21gnome-shell08:38:142
307235299427,15cyclictest26-21ksoftirqd/110:25:301
307235299427,15cyclictest26-21ksoftirqd/110:25:301
3072352994218,20cyclictest26-21ksoftirqd/107:40:301
3072352994215,9cyclictest26-21ksoftirqd/109:20:021
3072352994214,9cyclictest26-21ksoftirqd/111:05:221
307235299421,28cyclictest26-21ksoftirqd/110:55:151
307235299421,21cyclictest3122256-21/usr/sbin/munin09:30:341
307235299421,21cyclictest3122256-21/usr/sbin/munin09:30:341
3072352994211,8cyclictest26-21ksoftirqd/112:30:011
307234999423,19cyclictest13-21ksoftirqd/011:42:210
3072357994122,15cyclictest42-21ksoftirqd/312:35:223
3072357994122,15cyclictest42-21ksoftirqd/312:35:223
3072352994111,9cyclictest26-21ksoftirqd/110:50:151
3072352994022,11cyclictest26-21ksoftirqd/109:55:031
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional