You are here: Home / Projects / OSADL QA Farm Real-time / Latency plots / 
2025-06-21 - 22:18

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #7, slot #3

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.

Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of all highest latencies:
System rack7slot3s.osadl.org (updated Sat Jun 21, 2025 12:43:37)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
1201722170,3sleep10-21swapper/107:10:061
106692870,2sleep20-21swapper/210:21:232
276052820,5sleep11206699cyclictest11:30:341
276052820,5sleep11206699cyclictest11:30:341
251762810,2sleep00-21swapper/012:07:210
192752750,2sleep00-21swapper/007:30:050
37352740,2sleep00-21swapper/010:58:570
154552740,2sleep20-21swapper/211:15:222
1206599743,54cyclictest9-21ksoftirqd/009:25:200
1206599743,54cyclictest9-21ksoftirqd/009:25:200
1206599731,32cyclictest0-21swapper/007:10:170
4602720,5sleep31206899cyclictest12:16:143
1206799701,8cyclictest3476-21grep11:40:342
1206699707,24cyclictest14685-21taskset11:55:201
12065996928,35cyclictest0-21swapper/007:15:190
29612670,4sleep02958-21ls11:40:280
13432670,9sleep3381ktimersoftd/309:24:443
1206799675,18cyclictest8050irq/56-dwc_otg_12:10:122
12067996712,4cyclictest2218-21fschecks_count09:25:252
12067996712,4cyclictest2218-21fschecks_count09:25:252
1206799661,14cyclictest0-21swapper/211:23:492
1206899657,12cyclictest7950irq/56-dwc_otg_07:50:183
1206799656,10cyclictest7950irq/56-dwc_otg_10:30:562
12065996522,12cyclictest0-21swapper/007:55:170
1206799643,8cyclictest7850irq/56-dwc_otg12:35:192
256152630,1sleep20-21swapper/209:58:252
1206799632,7cyclictest0-21swapper/208:00:192
1206599621,6cyclictest8431-21munin-run08:30:050
12065996210,32cyclictest17185-21unixbench_multi08:50:350
12065996210,32cyclictest17185-21unixbench_multi08:50:350
1206799612,4cyclictest0-21swapper/207:40:212
1206799612,4cyclictest0-21swapper/207:40:212
1206599611,45cyclictest15983-21ssh10:30:060
1206799602,10cyclictest8050irq/56-dwc_otg_09:50:242
1206799601,14cyclictest0-21swapper/207:15:322
1206699606,39cyclictest8050irq/56-dwc_otg_12:00:251
1206899597,20cyclictest0-21swapper/308:35:203
1206799597,5cyclictest24250-21grep12:05:432
1206799591,5cyclictest1733-21ntp_states10:55:322
1206799591,4cyclictest7850irq/56-dwc_otg09:00:292
12065995931,5cyclictest19973-21fschecks_count09:50:260
12067995818,37cyclictest18947-21sshd08:55:362
1206799581,5cyclictest3290-21fschecks_count12:20:242
12065995824,19cyclictest0-21swapper/007:45:320
1206599582,33cyclictest0-21swapper/012:30:350
1206599581,40cyclictest0-21swapper/009:20:280
1206599581,38cyclictest5442-21/usr/sbin/munin09:30:360
1206799574,10cyclictest7950irq/56-dwc_otg_08:20:212
12067995717,37cyclictest12508-21grep12:30:362
1206799571,6cyclictest31491-21/usr/sbin/munin11:35:322
12065995732,6cyclictest7950irq/56-dwc_otg_11:20:240
12065995712,21cyclictest7639-21unixbench_multi11:45:360
1206799563,4cyclictest13651-21ssh11:53:532
1206799562,4cyclictest8050irq/56-dwc_otg_08:40:182
1206799562,10cyclictest18241-21ssh09:47:352
12065995643,5cyclictest7850irq/56-dwc_otg11:55:360
12065995625,3cyclictest0-21swapper/009:45:290
1206599561,44cyclictest31148-21wc10:50:350
1206599561,34cyclictest5580-21ssh10:15:250
1206599561,34cyclictest15798-21wget07:20:210
1206599561,34cyclictest15798-21wget07:20:210
12065995611,21cyclictest0-21swapper/009:05:210
170312550,2sleep30-21swapper/309:45:343
1206899553,12cyclictest8050irq/56-dwc_otg_11:40:183
1206799557,3cyclictest0-21swapper/207:35:182
1206799553,9cyclictest8050irq/56-dwc_otg_07:35:052
1206799553,8cyclictest8050irq/56-dwc_otg_07:29:042
1206799552,9cyclictest22187-21ssh12:04:272
1206799552,6cyclictest8050irq/56-dwc_otg_10:42:192
1206799551,8cyclictest8050irq/56-dwc_otg_11:32:322
1206799551,8cyclictest8050irq/56-dwc_otg_11:32:322
1206799551,5cyclictest19880-21ssh10:35:242
1206799551,4cyclictest15700-21/usr/sbin/munin07:20:322
1206799551,4cyclictest15700-21/usr/sbin/munin07:20:322
1206699555,7cyclictest0-21swapper/111:15:201
1206599553,33cyclictest10053-21timerandwakeup09:35:350
1206599552,7cyclictest17341-21grep10:30:360
12065995524,5cyclictest22694-21latency_hist12:05:060
1206799542,7cyclictest0-21swapper/212:25:402
1206799542,4cyclictest0-21swapper/211:10:232
1206799541,9cyclictest7850irq/56-dwc_otg11:48:362
1206799541,5cyclictest13834-21/usr/sbin/munin10:25:392
1206799541,4cyclictest8050irq/56-dwc_otg_09:17:012
1206799541,3cyclictest7950irq/56-dwc_otg_09:39:202
1206799541,3cyclictest0-21swapper/208:35:332
1206599547,6cyclictest0-21swapper/011:00:180
1206599544,36cyclictest29112-21ssh09:17:090
12065995433,6cyclictest7950irq/56-dwc_otg_11:15:050
12065995433,10cyclictest0-21swapper/012:10:120
1206599542,49cyclictest20454-21grep10:35:320
1206599541,32cyclictest30324-21aten_rbpower_po08:00:220
1206799534,6cyclictest8050irq/56-dwc_otg_12:15:252
12067995314,32cyclictest23067-21diskmemload10:47:352
12067995314,32cyclictest23067-21diskmemload10:47:352
1206799531,11cyclictest0-21swapper/210:12:042
1206799531,11cyclictest0-21swapper/210:12:042
1206599532,28cyclictest96950snmpd11:28:540
12065995312,31cyclictest321650kworker/u9:212:21:240
1206899523,8cyclictest7850irq/56-dwc_otg10:55:203
1206799521,3cyclictest0-21swapper/211:59:442
1206599525,26cyclictest16657-21head11:15:380
1206599522,30cyclictest5163-21aten_rbpower_vo08:20:230
1206599521,5cyclictest30554-21ssh11:35:180
1206599521,30cyclictest23487-21wget09:10:200
1206799519,4cyclictest279062chrt07:51:452
1206799516,7cyclictest8050irq/56-dwc_otg_10:54:442
1206799515,8cyclictest8050irq/56-dwc_otg_11:27:122
1206799512,4cyclictest5765-21unixbench_multi11:00:362
1206799511,8cyclictest8050irq/56-dwc_otg_11:08:092
1206799511,5cyclictest0-21swapper/209:11:112
1206799511,5cyclictest0-21swapper/208:08:512
1206799511,4cyclictest7850irq/56-dwc_otg10:01:342
1206799511,4cyclictest13708-21ls09:40:372
12067995113,4cyclictest8050irq/56-dwc_otg_09:30:262
1206699512,9cyclictest0-21swapper/108:50:191
1206699512,9cyclictest0-21swapper/108:50:191
1206699511,6cyclictest7850irq/56-dwc_otg12:30:201
1206599517,22cyclictest1215-21latency_hist08:10:050
1206599514,32cyclictest0-21swapper/010:00:120
12065995125,6cyclictest21385-21fschecks_count07:35:230
1206599512,29cyclictest14975-21ntp_kernel_pll_08:45:290
1206599511,28cyclictest23653-21fschecks_count10:40:280
1206599511,27cyclictest13750-21grep09:40:380
1206799506,7cyclictest8050irq/56-dwc_otg_07:45:592
1206799506,4cyclictest8050irq/56-dwc_otg_08:34:562
1206799501,5cyclictest8050irq/56-dwc_otg_10:06:432
1206799501,5cyclictest0-21swapper/210:17:222
1206699505,8cyclictest0-21swapper/109:30:211
12065995011,11cyclictest0-21swapper/008:35:190
12065994928,14cyclictest0-21swapper/008:40:230
1206599492,26cyclictest0-21swapper/012:35:220
1206599492,25cyclictest0-21swapper/010:05:370
1206599491,31cyclictest23521-21grep07:40:260
1206599491,31cyclictest23521-21grep07:40:260
50752480,4sleep112064-21cyclictest11:43:191
1206899484,11cyclictest11201-21ssh12:30:183
1206699483,10cyclictest8050irq/56-dwc_otg_12:25:221
12066994810,4cyclictest0-21swapper/110:10:271
12066994810,4cyclictest0-21swapper/110:10:271
12065994826,7cyclictest10873-21ssh12:30:050
12065994819,4cyclictest0-21swapper/010:20:200
1206599481,34cyclictest0-21swapper/011:50:170
1206599481,30cyclictest459-21ssh12:16:140
1206599481,30cyclictest0-21swapper/010:11:370
1206599481,30cyclictest0-21swapper/010:11:370
1206699477,23cyclictest0-21swapper/109:05:211
1206599471,29cyclictest0-21swapper/011:30:300
1206599471,29cyclictest0-21swapper/011:30:300
115612473,12sleep00-21swapper/007:07:020
306032460,3sleep30-21swapper/310:50:273
1206799461,5cyclictest0-21swapper/209:05:442
1206699462,9cyclictest0-21swapper/110:50:191
12066994610,6cyclictest8050irq/56-dwc_otg_07:40:201
12066994610,6cyclictest8050irq/56-dwc_otg_07:40:201
1206599461,30cyclictest0-21swapper/009:56:240
1206599461,29cyclictest0-21swapper/011:05:290
1206899456,24cyclictest0-21swapper/308:25:203
1206699457,24cyclictest0-21swapper/107:55:201
12066994523,6cyclictest2640450http10:00:061
12066994511,24cyclictest0-21swapper/109:45:211
1206599453,26cyclictest0-21swapper/007:30:180
12065994520,13cyclictest6851-21kworker/0:208:34:070
1206899447,24cyclictest0-21swapper/308:16:023
1206899442,4cyclictest7850irq/56-dwc_otg12:35:193
1206799442,12cyclictest0-21swapper/209:20:102
12067994412,4cyclictest15330-21cat08:45:352
1206699447,24cyclictest0-21swapper/108:10:211
1206699447,22cyclictest0-21swapper/108:45:201
1206699446,25cyclictest0-21swapper/111:05:211
12065994416,15cyclictest955-21runrttasks07:51:500
1206599441,29cyclictest18886-21grep08:55:360
1206799431,9cyclictest0-21swapper/207:57:472
1206699438,25cyclictest0-21swapper/111:20:111
1206699433,32cyclictest12817-21cut08:40:251
1206599436,24cyclictest0-21swapper/009:00:210
12065994322,5cyclictest7850irq/56-dwc_otg10:46:200
12065994322,5cyclictest7850irq/56-dwc_otg10:46:200
12065994320,13cyclictest0-21swapper/008:11:510
1206899425,23cyclictest27055-21ssh12:10:113
12066994226,5cyclictest23-21ksoftirqd/111:53:581
12066994216,4cyclictest8050irq/56-dwc_otg_09:35:191
1206899417,24cyclictest0-21swapper/307:40:203
1206899417,24cyclictest0-21swapper/307:40:203
1206899417,23cyclictest0-21swapper/312:00:253
12068994110,18cyclictest0-21swapper/311:30:063
1206699417,26cyclictest0-21swapper/108:30:111
1206699417,25cyclictest0-21swapper/109:25:211
1206699417,25cyclictest0-21swapper/109:25:211
1206699417,23cyclictest0-21swapper/108:55:221
1206699417,20cyclictest0-21swapper/108:15:201
12066994110,6cyclictest0-21swapper/109:20:171
1206599419,19cyclictest0-21swapper/008:15:230
43102400,2sleep30-21swapper/312:20:363
228112400,2sleep30-21swapper/309:54:473
12068994023,4cyclictest26429-21latency_hist10:00:063
1206799402,5cyclictest0-21swapper/207:12:252
1206699407,24cyclictest0-21swapper/110:45:251
1206699407,24cyclictest0-21swapper/110:45:251
12066994020,5cyclictest23-21ksoftirqd/107:40:051
1206699401,26cyclictest15751-21ls12:35:261
110982400,8sleep3381ktimersoftd/307:05:353
75982390,2sleep30-21swapper/310:17:463
1206899394,4cyclictest7850irq/56-dwc_otg10:45:243
1206899394,4cyclictest7850irq/56-dwc_otg10:45:243
12068993913,5cyclictest5728-21fschecks_count09:30:283
1206799393,22cyclictest7950irq/56-dwc_otg_08:30:062
1206699395,18cyclictest23-21ksoftirqd/109:11:101
12066993924,4cyclictest21-21rcuc/110:55:221
12066993920,10cyclictest21-21rcuc/112:09:521
12066993919,5cyclictest2692150wget10:00:221
12066993918,4cyclictest6382-21sh11:01:581
12066993912,3cyclictest7850irq/56-dwc_otg11:10:211
1206899386,20cyclictest18859-21ssh11:20:223
12068993823,5cyclictest381ktimersoftd/310:40:563
1206699388,17cyclictest7950irq/56-dwc_otg_12:20:331
1206699388,15cyclictest7950irq/56-dwc_otg_08:40:051
1206699381,20cyclictest8644-21cat08:30:061
1206799371,12cyclictest0-21swapper/208:54:492
1206799371,12cyclictest0-21swapper/208:54:492
1206699379,15cyclictest7850irq/56-dwc_otg08:20:281
1206699378,10cyclictest7850irq/56-dwc_otg10:25:321
1206699377,25cyclictest0-21swapper/107:20:211
1206699377,25cyclictest0-21swapper/107:20:211
1206699377,16cyclictest221ktimersoftd/109:50:121
1206699376,14cyclictest221ktimersoftd/110:20:051
1206699371,4cyclictest8050irq/56-dwc_otg_07:45:241
1206899361,5cyclictest0-21swapper/308:20:203
1206699368,13cyclictest7850irq/56-dwc_otg11:45:481
1206699367,16cyclictest0-21swapper/108:05:211
1206699366,10cyclictest23-21ksoftirqd/111:30:051
1206699365,21cyclictest19742-21ssh10:35:121
1206699362,16cyclictest7850irq/56-dwc_otg10:05:271
12066993619,4cyclictest23-21ksoftirqd/108:00:221
1206699361,6cyclictest28673-21rm12:11:011
12066993613,5cyclictest23-21ksoftirqd/107:15:051
1206899354,5cyclictest0-21swapper/311:35:063
1206899354,5cyclictest0-21swapper/311:35:063
1206899353,7cyclictest8392-21fschecks_count11:05:253
12068993521,8cyclictest39-21ksoftirqd/310:00:193
12068993512,4cyclictest12254-21latency_hist10:25:053
1206899351,22cyclictest0-21swapper/307:20:253
1206899351,22cyclictest0-21swapper/307:20:253
1206899351,20cyclictest8050irq/56-dwc_otg_11:40:053
42182340,2sleep30-21swapper/310:13:233
42182340,2sleep30-21swapper/310:13:233
1206899347,15cyclictest0-21swapper/309:40:213
12068993416,4cyclictest8448-21sh12:25:413
1206899341,5cyclictest955-21runrttasks11:18:193
12068993415,4cyclictest13552-21timerandwakeup10:25:373
1206899341,24cyclictest5165-21latency11:00:283
1206899341,23cyclictest2481-21latency09:25:283
1206899341,23cyclictest2481-21latency09:25:283
1206799341,8cyclictest0-21swapper/208:12:052
1206699348,15cyclictest221ktimersoftd/112:17:371
1206699348,12cyclictest221ktimersoftd/107:50:181
12066993411,8cyclictest7850irq/56-dwc_otg09:19:411
12066993410,8cyclictest7850irq/56-dwc_otg11:35:211
1206899334,4cyclictest7950irq/56-dwc_otg_09:05:363
1206899333,7cyclictest7950irq/56-dwc_otg_08:55:203
12068993316,4cyclictest17917-21ssh11:59:083
12068993314,10cyclictest955-21runrttasks09:00:523
1206899331,22cyclictest8050irq/56-dwc_otg_07:55:193
12068993310,12cyclictest0-21swapper/310:35:253
1206699338,15cyclictest0-21swapper/110:40:241
1206699337,23cyclictest0-21swapper/107:15:191
12066993323,8cyclictest16453-21fschecks_time10:30:261
1206899327,6cyclictest7950irq/56-dwc_otg_11:45:363
1206899322,20cyclictest0-21swapper/307:35:513
12068993217,11cyclictest0-21swapper/307:45:383
12068993210,3cyclictest0-21swapper/310:30:373
1206799321,9cyclictest0-21swapper/208:17:262
1206699323,10cyclictest0-21swapper/107:25:191
12066993216,8cyclictest14770-21sh09:42:451
12066993212,4cyclictest0-21swapper/110:20:171
1206699321,16cyclictest221ktimersoftd/107:30:171
1206899316,5cyclictest7950irq/56-dwc_otg_09:20:053
1206899314,14cyclictest39-21ksoftirqd/311:10:183
1206899312,20cyclictest0-21swapper/310:09:563
1206899312,19cyclictest0-21swapper/312:05:323
1206899311,18cyclictest0-21swapper/307:26:173
1206699311,4cyclictest7850irq/56-dwc_otg09:00:281
110542316,14sleep20-21swapper/207:05:352
1206899306,14cyclictest13986-21kworker/3:008:45:183
1206899306,14cyclictest0-21swapper/308:40:123
1206899303,17cyclictest0-21swapper/309:12:103
12068993011,5cyclictest8050irq/56-dwc_otg_11:50:253
1206899292,6cyclictest7950irq/56-dwc_otg_07:10:263
1206899292,18cyclictest0-21swapper/308:13:063
1206899292,18cyclictest0-21swapper/307:33:023
1206899291,25cyclictest17760-21ls08:55:063
1206899291,25cyclictest17760-21ls08:55:063
12068992910,4cyclictest0-21swapper/309:35:183
1206899284,10cyclictest8050irq/56-dwc_otg_07:15:253
1206899282,17cyclictest0-21swapper/308:00:183
1206899277,5cyclictest9844-21grep08:30:353
1206899271,14cyclictest8050irq/56-dwc_otg_08:05:283
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional