You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-03-11 - 15:02

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #7, slot #4

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the 376 highest latencies:
System rack7slot4s.osadl.org (updated Wed Mar 11, 2026 12:45:11)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
2020999649,8cyclictest131rcu_preempt08:15:110
20234995828,21cyclictest28366irq/58-eth010:20:103
20234995029,11cyclictest28366irq/58-eth010:45:133
2023499502,17cyclictest28366irq/58-eth009:45:133
2023499493,28cyclictest28366irq/58-eth012:35:123
2023499477,25cyclictest0-21swapper/310:30:113
20209994729,12cyclictest12-21ksoftirqd/012:15:130
2020999464,30cyclictest3188-21ssh10:20:120
2021799453,31cyclictest21215-21ssh10:30:111
2020999427,28cyclictest28499-21ssh11:10:120
2020999422,32cyclictest9913-21rm09:30:130
2023499414,22cyclictest28366irq/58-eth009:10:133
2023499412,24cyclictest28366irq/58-eth012:10:133
20217994130,8cyclictest201rcuc/110:00:121
2020999410,2cyclictest131rcu_preempt09:25:130
2023499404,26cyclictest28366irq/58-eth011:30:113
2023499402,24cyclictest28366irq/58-eth011:35:123
2022699401,30cyclictest10887-21ssh12:30:112
2020999404,31cyclictest5773-21diskmemload09:40:150
20226993920,11cyclictest0-21swapper/208:45:132
2022699391,18cyclictest924-21snmpd10:15:112
2021799397,23cyclictest21-21ksoftirqd/107:20:131
2020999392,6cyclictest131rcu_preempt08:20:120
2020999391,30cyclictest32103-21ssh11:30:100
2023499382,21cyclictest28366irq/58-eth010:40:123
2022699382,28cyclictest9289-21grep10:40:202
2023499364,18cyclictest28366irq/58-eth010:35:133
20234993518,9cyclictest0-21swapper/307:45:103
2020999355,22cyclictest5845-21kthreadcore09:45:200
2020999355,20cyclictest15880-21ssh10:45:120
2020999354,20cyclictest12-21ksoftirqd/008:00:120
2022699349,14cyclictest31820-21ssh10:00:122
20226993410,17cyclictest0-21swapper/209:12:562
20217993324,5cyclictest0-21swapper/107:55:141
2020999331,28cyclictest0-21swapper/011:45:120
2020999331,28cyclictest0-21swapper/011:45:120
2023499322,19cyclictest28366irq/58-eth008:15:123
2021799321,19cyclictest12571-21ssh11:55:101
2020999322,23cyclictest8694-21ssh11:35:130
2020999322,22cyclictest24499-21grep10:30:200
20209993220,8cyclictest12-21ksoftirqd/009:15:150
2020999321,23cyclictest14119-21ssh11:20:140
2023499311,19cyclictest28366irq/58-eth012:15:123
2023499311,17cyclictest28366irq/58-eth011:40:133
2022699315,10cyclictest8442-21ssh10:05:122
20226993119,10cyclictest0-21swapper/212:05:122
20226993112,12cyclictest0-21swapper/211:36:212
2020999314,17cyclictest12-21ksoftirqd/010:50:110
20209993112,10cyclictest7268-21ssh12:10:130
20209993110,15cyclictest0-21swapper/012:25:120
20226993012,7cyclictest0-21swapper/211:09:322
2023499291,20cyclictest28366irq/58-eth010:15:123
2022699296,13cyclictest27-21ksoftirqd/212:02:582
20226992913,9cyclictest0-21swapper/209:22:332
2020999292,20cyclictest31894-21grep10:35:190
20209992913,10cyclictest12-21ksoftirqd/007:45:090
2022699288,14cyclictest0-21swapper/211:47:372
2022699288,14cyclictest0-21swapper/211:47:372
2022699283,17cyclictest22346irq/40-dwc2_hso07:25:152
20226992815,4cyclictest27-21ksoftirqd/209:25:552
20226992812,10cyclictest0-21swapper/210:23:112
20226992811,7cyclictest0-21swapper/211:25:362
2022699281,16cyclictest12598-21ssh11:55:122
20226992811,10cyclictest0-21swapper/210:13:412
20226992810,7cyclictest27-21ksoftirqd/211:34:312
2020999282,19cyclictest2234-21kthreadcore10:00:210
2022699275,15cyclictest27-21ksoftirqd/212:39:242
20226992716,5cyclictest27-21ksoftirqd/211:04:402
20226992716,5cyclictest27-21ksoftirqd/211:04:402
20217992710,9cyclictest21-21ksoftirqd/111:51:211
2020999276,11cyclictest0-21swapper/008:10:140
2020999274,14cyclictest5113-21ssh11:15:130
2020999272,19cyclictest5773-21diskmemload12:38:570
20234992610,9cyclictest0-21swapper/312:20:123
2022699269,11cyclictest0-21swapper/211:41:032
2022699268,12cyclictest0-21swapper/211:10:452
2022699267,13cyclictest27-21ksoftirqd/209:54:242
2022699262,16cyclictest22346irq/40-dwc2_hso11:15:152
2022699262,10cyclictest0-21swapper/208:55:132
20226992612,10cyclictest0-21swapper/209:35:132
2021799268,9cyclictest21-21ksoftirqd/112:07:131
20217992617,7cyclictest201rcuc/110:40:121
20209992610,10cyclictest20201-21cyclictest07:30:120
2023499253,15cyclictest28366irq/58-eth009:30:123
2023499251,13cyclictest28366irq/58-eth010:00:113
2022699259,9cyclictest131rcu_preempt12:16:292
2022699259,3cyclictest27-21ksoftirqd/208:30:292
2022699257,5cyclictest0-21swapper/209:41:162
2022699257,12cyclictest0-21swapper/212:21:462
2022699253,16cyclictest22346irq/40-dwc2_hso10:45:122
2022699253,13cyclictest0-21swapper/210:26:342
2022699253,13cyclictest0-21swapper/210:26:342
20226992514,9cyclictest3554-21ssh10:36:312
20226992514,8cyclictest0-21swapper/212:10:112
20226992514,3cyclictest0-21swapper/208:40:142
20226992514,3cyclictest0-21swapper/208:40:142
20226992512,7cyclictest0-21swapper/209:58:252
2022699251,13cyclictest1897-21ssh12:25:132
20217992512,3cyclictest131rcu_preempt11:45:131
20217992512,3cyclictest131rcu_preempt11:45:131
2021799251,16cyclictest1898-21ssh12:25:131
2020999252,19cyclictest1428-21ssh10:18:300
2020999251,18cyclictest21551-21ssh12:00:110
2023499245,13cyclictest28366irq/58-eth008:10:133
2023499243,13cyclictest0-21swapper/310:06:203
2023499243,12cyclictest0-21swapper/312:30:113
2022699246,9cyclictest131rcu_preempt11:20:342
2022699245,4cyclictest131rcu_preempt07:30:112
2022699242,16cyclictest22346irq/40-dwc2_hso09:05:162
20226992413,4cyclictest0-21swapper/209:45:152
20226992411,7cyclictest0-21swapper/211:53:152
20226992411,7cyclictest0-21swapper/209:19:322
20226992411,3cyclictest0-21swapper/210:55:042
2021799249,9cyclictest131rcu_preempt09:20:241
20217992410,3cyclictest131rcu_preempt12:15:021
2020999248,8cyclictest0-21swapper/011:50:130
2020999245,13cyclictest0-21swapper/007:15:130
2020999241,19cyclictest6180-21ssh09:10:130
20209992411,6cyclictest0-21swapper/011:25:130
2023499234,12cyclictest28366irq/58-eth010:10:143
2023499231,11cyclictest28366irq/58-eth007:40:143
2022699234,13cyclictest0-21swapper/210:31:392
2022699232,14cyclictest22346irq/40-dwc2_hso08:25:102
20226992314,3cyclictest0-21swapper/208:05:262
20226992312,9cyclictest9784-21ssh09:30:062
20226992311,9cyclictest0-21swapper/207:45:152
2022699230,11cyclictest2141-21latency_hist07:25:012
2021799239,4cyclictest21-21ksoftirqd/111:19:461
2021799237,10cyclictest21-21ksoftirqd/109:05:161
2021799233,5cyclictest21-21ksoftirqd/109:10:351
2021799233,16cyclictest30261-21ssh10:35:131
2021799232,17cyclictest23516-21kworker/u8:012:20:131
20217992312,8cyclictest616-21dbus-daemon12:18:531
20217992312,8cyclictest30950-21cat10:15:281
20217992310,4cyclictest21-21ksoftirqd/109:26:091
20217992310,4cyclictest21-21ksoftirqd/109:00:261
20217992310,4cyclictest21-21ksoftirqd/107:40:251
20217992310,11cyclictest0-21swapper/109:42:511
2020999235,14cyclictest633-21Async12:11:530
2020999231,17cyclictest5773-21diskmemload10:05:140
2023499226,8cyclictest0-21swapper/312:00:103
2023499221,13cyclictest28466irq/59-eth009:35:113
2022699221,4cyclictest271ksoftirqd/207:35:272
20226992213,7cyclictest0-21swapper/208:50:292
20226992210,9cyclictest0-21swapper/207:15:172
2021799226,7cyclictest21-21ksoftirqd/111:32:341
2021799225,7cyclictest21-21ksoftirqd/111:03:291
2021799225,7cyclictest21-21ksoftirqd/111:03:291
2021799225,12cyclictest21-21ksoftirqd/110:14:201
20217992210,4cyclictest21-21ksoftirqd/109:33:461
20209992213,6cyclictest864-21sshd12:05:200
2020999221,19cyclictest31491-21grep07:55:180
20234992110,6cyclictest0-21swapper/311:50:203
20234992110,6cyclictest0-21swapper/311:21:173
2022699214,11cyclictest0-21swapper/210:53:152
2022699212,8cyclictest27-21ksoftirqd/207:55:252
2021799219,4cyclictest21-21ksoftirqd/110:22:541
2021799217,4cyclictest21-21ksoftirqd/109:35:311
2021799217,3cyclictest21-21ksoftirqd/110:29:331
2021799217,3cyclictest21-21ksoftirqd/110:29:331
2021799216,7cyclictest21-21ksoftirqd/109:46:181
2021799216,7cyclictest131rcu_preempt11:10:071
2021799214,9cyclictest21-21ksoftirqd/109:19:021
2021799213,12cyclictest0-21swapper/109:50:121
2021799211,15cyclictest28603-21ls12:40:011
2021799211,15cyclictest26464-21ssh09:55:241
20217992110,4cyclictest21-21ksoftirqd/107:10:141
20217992110,3cyclictest0-21swapper/111:05:571
2020999219,3cyclictest131rcu_preempt09:20:310
2020999216,3cyclictest131rcu_preempt09:55:110
2020999213,7cyclictest12306-21df_inode10:25:140
2020999213,7cyclictest12306-21df_inode10:25:130
2020999212,15cyclictest27595-21apt-get08:25:110
2020999212,11cyclictest14960-21sed12:30:260
20209992111,7cyclictest7861-1kworker/u9:010:10:280
2020999211,15cyclictest0-21swapper/007:40:150
2023499209,9cyclictest0-21swapper/312:25:413
2023499209,9cyclictest0-21swapper/309:50:313
2023499209,6cyclictest0-21swapper/310:27:213
2023499209,6cyclictest0-21swapper/310:27:213
20234992010,8cyclictest0-21swapper/310:55:153
20234992010,6cyclictest0-21swapper/311:25:123
2022699208,4cyclictest27-21ksoftirqd/207:15:012
2022699207,10cyclictest16708-21find08:10:272
20226992011,7cyclictest0-21swapper/208:15:222
20226992011,3cyclictest0-21swapper/209:00:172
2021799209,4cyclictest21-21ksoftirqd/112:03:051
2021799209,4cyclictest21-21ksoftirqd/108:35:011
2021799208,9cyclictest3571-21apt-get08:00:111
2021799208,4cyclictest21-21ksoftirqd/111:41:191
2021799207,5cyclictest131rcu_preempt11:36:241
2021799205,4cyclictest21-21ksoftirqd/111:28:071
2021799203,8cyclictest21-21ksoftirqd/110:50:171
2021799201,15cyclictest13824-21kthreadcore07:35:211
2021799201,14cyclictest15896-21sh10:45:131
2020999206,9cyclictest12-21ksoftirqd/010:55:140
2023499197,9cyclictest0-21swapper/311:10:223
2023499193,11cyclictest0-21swapper/312:08:213
2023499193,11cyclictest0-21swapper/311:45:203
2023499193,11cyclictest0-21swapper/311:45:193
2023499193,11cyclictest0-21swapper/311:17:203
2023499193,11cyclictest0-21swapper/310:53:373
2023499192,11cyclictest0-21swapper/309:05:163
2023499192,11cyclictest0-21swapper/308:30:143
20234991911,5cyclictest28366irq/58-eth009:25:133
20234991911,5cyclictest28366irq/58-eth009:20:133
2023499191,13cyclictest0-21swapper/309:55:243
2023499191,11cyclictest0-21swapper/308:35:053
2023499191,11cyclictest0-21swapper/307:20:163
2022699199,7cyclictest16782-21apt-get07:40:142
2022699191,9cyclictest8231-21ntpq08:35:242
2022699191,9cyclictest4518-21kthreadcore08:00:192
2022699191,9cyclictest27502-21latency_hist08:25:022
2022699191,16cyclictest0-21swapper/207:10:022
2022699191,15cyclictest26507-21fschecks_count07:50:162
2021799199,4cyclictest21-21ksoftirqd/111:20:431
2021799199,4cyclictest21-21ksoftirqd/108:50:201
2021799196,4cyclictest131rcu_preempt12:31:431
2021799195,2cyclictest131rcu_preempt10:05:161
2021799195,11cyclictest24279-21kthreadcore07:45:191
2021799194,5cyclictest21-21ksoftirqd/110:55:201
2021799192,13cyclictest839-21munin-node08:05:141
20217991914,3cyclictest0-21swapper/107:15:141
20217991913,4cyclictest0-21swapper/108:40:251
20217991913,4cyclictest0-21swapper/108:40:251
2021799191,14cyclictest7176-21apt-get07:30:111
2020999197,9cyclictest5855-21sed09:10:000
2020999192,14cyclictest17313-21apt-get11:40:050
2020999192,12cyclictest16252-21ssh11:55:250
2020999191,9cyclictest2262-21latency_hist07:25:010
2020999191,9cyclictest11961-21cpu07:35:140
2020999191,9cyclictest0-21swapper/012:23:260
2020999191,5cyclictest131rcu_preempt09:50:130
2020999190,9cyclictest14264-21latency_hist08:45:010
2020999190,9cyclictest14264-21latency_hist08:45:010
2020999190,15cyclictest12092-21timerwakeupswit08:05:270
2023499188,8cyclictest0-21swapper/309:40:493
2023499183,11cyclictest0-21swapper/311:03:393
2023499183,11cyclictest0-21swapper/311:03:383
2023499183,10cyclictest0-21swapper/311:09:203
2023499182,9cyclictest0-21swapper/311:55:123
2023499182,10cyclictest0-21swapper/308:55:123
2023499182,10cyclictest0-21swapper/308:45:133
2023499182,10cyclictest0-21swapper/307:55:143
2023499182,10cyclictest0-21swapper/307:25:163
2023499182,10cyclictest0-21swapper/307:10:143
2021799185,4cyclictest21-21ksoftirqd/108:20:261
20217991812,4cyclictest0-21swapper/108:35:121
2021799181,14cyclictest18169-21grep08:15:161
2020999183,9cyclictest0-21swapper/008:50:120
2020999183,13cyclictest5383-21irqrtprio08:35:180
2020999181,9cyclictest25294-21kthreadcore08:55:190
20209991811,5cyclictest10407-21ssh11:00:100
20209991811,5cyclictest10407-21ssh11:00:100
2023499179,6cyclictest0-21swapper/309:16:103
2023499171,12cyclictest0-21swapper/308:25:193
2023499171,11cyclictest0-21swapper/307:50:173
2023499171,10cyclictest0-21swapper/308:55:023
2021799178,6cyclictest616-21dbus-daemon08:48:081
2021799172,10cyclictest0-21swapper/107:50:141
20217991711,4cyclictest0-21swapper/107:25:141
2021799171,12cyclictest27595-21apt-get08:25:111
2021799171,11cyclictest27798-21unixbench_multi08:55:281
2021799171,10cyclictest20127-21latency_hist07:10:021
2020999179,5cyclictest19529-21irqrtprio09:35:170
2020999177,8cyclictest3729-21kthreadcore07:25:210
2020999172,4cyclictest12-21ksoftirqd/011:09:500
2020999172,10cyclictest0-21swapper/008:30:140
2020999171,9cyclictest23099-21kthreadcore07:10:210
2020999171,4cyclictest0-21swapper/010:40:100
2020999171,10cyclictest31081-21ls07:55:010
2020999171,10cyclictest14551-21cut08:45:150
2023499161,11cyclictest0-21swapper/308:00:203
2023499160,8cyclictest0-21swapper/308:40:123
2023499160,8cyclictest0-21swapper/308:40:123
2021799162,11cyclictest14235-21kthreadcore08:10:191
2023499157,6cyclictest0-21swapper/307:18:203
2023499152,10cyclictest0-21swapper/307:35:143
2023499142,8cyclictest0-21swapper/308:20:133
2020999142,10cyclictest20269-21latency_hist07:10:020
2023499133,7cyclictest0-21swapper/309:00:143
2023499131,10cyclictest0-21swapper/308:05:223
2023499122,6cyclictest0-21swapper/307:30:133
2023499101,6cyclictest0-21swapper/307:10:023
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional