You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2025-12-12 - 18:47

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #c, slot #7

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the highest latencies:
System (updated Fri Dec 12, 2025 00:44:54)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
96586021060,3chrt965853-21perf23:04:593
88181029578,10sleep00-21swapper/019:08:520
9522172860,8sleep31753-21gnome-shell22:25:153
88206799810,76cyclictest1622-21rtkit-daemon23:27:210
88131227558,11sleep20-21swapper/219:05:282
88155927144,21sleep30-21swapper/319:05:423
88035626443,13sleep10-21swapper/119:05:021
8964422610,5sleep10-21swapper/119:50:011
9717152600,17sleep234-21ksoftirqd/223:20:172
162399600,10rtkit-daemon1622-21rtkit-daemon19:41:581
162399600,10rtkit-daemon1622-21rtkit-daemon19:41:581
882071995924,20cyclictest26-21ksoftirqd/100:00:011
9881462580,9sleep11753-21gnome-shell00:05:321
9741152550,15sleep126-21ksoftirqd/123:25:271
88207199555,46cyclictest1622-21rtkit-daemon23:38:031
88207199555,46cyclictest1622-21rtkit-daemon23:38:021
162399550,9rtkit-daemon1622-21rtkit-daemon19:24:500
162399550,9rtkit-daemon1622-21rtkit-daemon19:24:500
162399550,8rtkit-daemon1622-21rtkit-daemon00:33:580
9353362540,6chrt0-21swapper/121:35:311
882071995419,19cyclictest26-21ksoftirqd/122:20:001
88206799540,49cyclictest1622-21rtkit-daemon23:45:110
882071995328,9cyclictest26-21ksoftirqd/119:10:251
882076995228,20cyclictest1753-21gnome-shell22:05:353
882071995232,16cyclictest26-21ksoftirqd/119:25:291
882073995127,20cyclictest1753-21gnome-shell20:50:182
882071995127,9cyclictest26-21ksoftirqd/122:15:021
882071995115,20cyclictest26-21ksoftirqd/121:30:011
882071995114,19cyclictest26-21ksoftirqd/123:10:001
88207199511,12cyclictest26-21ksoftirqd/121:45:021
882076995026,20cyclictest1753-21gnome-shell00:10:263
882071995023,9cyclictest26-21ksoftirqd/100:30:291
88207199501,20cyclictest26-21ksoftirqd/120:45:191
882071995010,19cyclictest26-21ksoftirqd/122:45:191
882067995010,6cyclictest141rcu_preempt00:36:280
9612932490,8chrt2197014-21PK-Backend22:50:193
882073994925,20cyclictest1753-21gnome-shell19:55:312
88207199497,23cyclictest26-21ksoftirqd/100:36:181
882071994915,18cyclictest26-21ksoftirqd/120:35:011
882071994912,20cyclictest26-21ksoftirqd/119:55:011
88207199491,12cyclictest1753-21gnome-shell22:45:011
882067994912,6cyclictest141rcu_preempt22:26:440
162399490,41rtkit-daemon1775-21gvfs-afc-volume00:11:350
9089152480,5chrt0-21swapper/020:25:020
882076994824,20cyclictest1753-21gnome-shell21:40:013
882076994824,15cyclictest42-21ksoftirqd/300:15:433
882076994821,15cyclictest42-21ksoftirqd/319:30:163
882071994825,8cyclictest26-21ksoftirqd/120:20:001
882071994816,18cyclictest26-21ksoftirqd/120:06:101
882071994812,9cyclictest26-21ksoftirqd/123:15:011
882071994812,9cyclictest26-21ksoftirqd/123:15:011
882071994812,19cyclictest26-21ksoftirqd/119:25:011
882071994812,19cyclictest26-21ksoftirqd/119:25:011
88207199481,17cyclictest1753-21gnome-shell19:15:031
882067994814,5cyclictest141rcu_preempt19:40:170
882067994814,5cyclictest141rcu_preempt19:40:170
882067994813,6cyclictest141rcu_preempt23:45:010
882067994813,6cyclictest141rcu_preempt20:05:020
882067994812,5cyclictest141rcu_preempt23:00:010
162399480,35rtkit-daemon937985-21apt21:45:141
9209832470,15sleep342-21ksoftirqd/320:57:253
9051982470,11sleep2882061-21cyclictest20:15:012
882076994723,20cyclictest1753-21gnome-shell19:35:213
882076994723,13cyclictest42-21ksoftirqd/320:20:013
88207199478,19cyclictest26-21ksoftirqd/122:00:011
88207199476,7cyclictest3242253-21nautilus00:15:011
882071994725,5cyclictest9132052needreboot20:35:271
88207199471,9cyclictest26-21ksoftirqd/122:40:011
882071994713,9cyclictest26-21ksoftirqd/121:10:011
88206799475,12cyclictest141rcu_preempt22:55:010
882067994713,20cyclictest1753-21gnome-shell21:21:480
882076994622,16cyclictest42-21ksoftirqd/321:43:203
882073994622,20cyclictest1753-21gnome-shell00:20:162
882073994622,20cyclictest1753-21gnome-shell00:20:162
88207199469,19cyclictest26-21ksoftirqd/123:50:021
88207199465,26cyclictest26-21ksoftirqd/123:20:311
88207199462,9cyclictest261ksoftirqd/120:50:251
882071994620,10cyclictest26-21ksoftirqd/122:05:011
882071994614,11cyclictest26-21ksoftirqd/100:00:201
88207199461,19cyclictest26-21ksoftirqd/121:20:011
882071994610,9cyclictest26-21ksoftirqd/120:55:151
88206799466,5cyclictest141rcu_preempt21:45:030
882067994614,16cyclictest13-21ksoftirqd/000:10:020
882076994524,10cyclictest42-21ksoftirqd/323:52:283
882076994522,14cyclictest42-21ksoftirqd/320:10:133
88207699452,19cyclictest950770-21missed_timers22:20:233
882076994520,14cyclictest42-21ksoftirqd/323:25:173
882076994519,21cyclictest959672-40lsb_release22:45:223
882076994518,14cyclictest42-21ksoftirqd/321:12:213
88207699451,16cyclictest8933522cat19:40:153
88207699451,16cyclictest8933522cat19:40:153
88207199455,18cyclictest26-21ksoftirqd/122:20:081
88207199453,20cyclictest26-21ksoftirqd/121:25:021
88207199453,10cyclictest26-21ksoftirqd/121:15:011
882071994510,19cyclictest26-21ksoftirqd/100:20:251
882071994510,19cyclictest26-21ksoftirqd/100:20:241
88206799452,11cyclictest141rcu_preempt21:10:010
882067994515,15cyclictest141rcu_preempt23:35:150
882067994515,15cyclictest141rcu_preempt23:35:140
162399450,33rtkit-daemon1753-21gnome-shell22:17:370
9333962440,7sleep20-21swapper/221:30:332
9333962440,7sleep20-21swapper/221:30:332
882076994436,5cyclictest0-21swapper/319:56:483
882076994423,16cyclictest42-21ksoftirqd/323:05:303
882076994419,13cyclictest42-21ksoftirqd/300:20:213
882076994419,13cyclictest42-21ksoftirqd/300:20:203
882076994413,27cyclictest1753-21gnome-shell20:30:273
88207199448,19cyclictest26-21ksoftirqd/120:05:001
88207199446,10cyclictest26-21ksoftirqd/120:25:191
882071994417,5cyclictest141rcu_preempt22:56:041
882071994412,13cyclictest26-21ksoftirqd/120:21:181
882071994410,9cyclictest26-21ksoftirqd/121:00:191
88206799449,13cyclictest141rcu_preempt00:25:340
882067994424,16cyclictest912673-21cpuspeed_turbos20:35:170
162399440,30rtkit-daemon899422-21users19:55:320
882076994326,6cyclictest42-21ksoftirqd/322:55:283
882076994325,6cyclictest42-21ksoftirqd/300:00:013
882076994323,16cyclictest42-21ksoftirqd/320:52:053
882076994323,15cyclictest42-21ksoftirqd/321:15:293
882076994322,13cyclictest42-21ksoftirqd/300:35:023
88207699431,37cyclictest883691-21cron19:15:003
88207699431,12cyclictest932037-21runrttasks21:27:373
88207199438,20cyclictest26-21ksoftirqd/123:50:271
88207199438,20cyclictest26-21ksoftirqd/121:55:021
882067994321,17cyclictest984152-21df23:55:190
882067994315,7cyclictest141rcu_preempt21:27:370
882067994314,18cyclictest13-21ksoftirqd/022:40:010
882067994314,14cyclictest141rcu_preempt20:10:150
882067994313,14cyclictest141rcu_preempt21:50:180
9458552420,5sleep2331rcuc/222:05:342
882076994225,6cyclictest42-21ksoftirqd/300:06:503
882076994223,6cyclictest42-21ksoftirqd/300:00:153
882076994223,14cyclictest42-21ksoftirqd/320:00:293
882076994222,7cyclictest42-21ksoftirqd/320:10:023
882076994222,6cyclictest42-21ksoftirqd/323:10:173
882076994222,6cyclictest42-21ksoftirqd/323:10:173
882076994218,15cyclictest42-21ksoftirqd/319:15:043
882076994213,17cyclictest42-21ksoftirqd/323:35:323
882076994213,17cyclictest42-21ksoftirqd/323:35:323
882076994212,6cyclictest141rcu_preempt20:25:293
88207199427,19cyclictest26-21ksoftirqd/123:30:321
88207199424,8cyclictest26-21ksoftirqd/120:15:021
88207199422,18cyclictest26-21ksoftirqd/120:45:021
882071994220,8cyclictest26-21ksoftirqd/122:06:331
882067994226,11cyclictest925102-21rm21:10:030
882067994215,7cyclictest141rcu_preempt23:50:270
882067994214,6cyclictest141rcu_preempt22:45:320
882067994214,13cyclictest141rcu_preempt21:35:020
882067994214,13cyclictest141rcu_preempt21:35:010
882067994211,16cyclictest141rcu_preempt19:15:250
88207699419,14cyclictest1753-21gnome-shell21:46:203
88207699415,10cyclictest1753-21gnome-shell19:50:153
882076994125,6cyclictest42-21ksoftirqd/323:17:063
882076994125,6cyclictest42-21ksoftirqd/322:10:133
882076994124,6cyclictest42-21ksoftirqd/320:40:013
882076994124,6cyclictest42-21ksoftirqd/300:26:103
882076994123,6cyclictest42-21ksoftirqd/323:35:013
882076994123,6cyclictest42-21ksoftirqd/321:05:253
882076994119,13cyclictest42-21ksoftirqd/300:36:253
88207399412,9cyclictest1753-21gnome-shell19:45:152
882073994124,12cyclictest34-21ksoftirqd/222:45:312
882073994118,14cyclictest34-21ksoftirqd/200:35:012
88207199418,13cyclictest26-21ksoftirqd/119:30:531
88207199416,18cyclictest979444-21python323:40:291
882071994115,9cyclictest26-21ksoftirqd/100:30:001
882071994115,9cyclictest26-21ksoftirqd/100:20:001
88206799419,5cyclictest141rcu_preempt23:15:020
88206799419,5cyclictest141rcu_preempt23:15:020
88206799415,5cyclictest141rcu_preempt21:55:260
882067994115,6cyclictest141rcu_preempt20:45:390
882067994115,5cyclictest141rcu_preempt22:01:160
882067994114,6cyclictest141rcu_preempt22:40:140
882067994114,6cyclictest141rcu_preempt21:45:040
882067994114,6cyclictest141rcu_preempt19:45:110
882067994113,7cyclictest141rcu_preempt23:05:180
882067994110,19cyclictest141rcu_preempt22:10:140
882076994025,10cyclictest956530-21sshd22:36:143
882076994024,6cyclictest42-21ksoftirqd/322:01:143
882076994024,6cyclictest42-21ksoftirqd/320:44:563
882076994023,6cyclictest42-21ksoftirqd/320:21:193
882076994022,6cyclictest42-21ksoftirqd/321:50:313
882076994020,12cyclictest42-21ksoftirqd/321:20:263
882076994019,16cyclictest2179-21gvfsd-metadata22:45:013
88207399402,9cyclictest1753-21gnome-shell21:10:162
88207399402,9cyclictest1753-21gnome-shell20:20:232
88207399402,9cyclictest1753-21gnome-shell19:45:012
88207399402,9cyclictest1753-21gnome-shell19:45:002
88207399402,8cyclictest1753-21gnome-shell23:44:442
88207399402,8cyclictest1753-21gnome-shell00:10:142
88207399401,18cyclictest1753-21gnome-shell23:50:222
88207399401,13cyclictest949405-21grep22:15:342
88207399401,13cyclictest1753-21gnome-shell23:25:262
88207199409,17cyclictest26-21ksoftirqd/119:55:201
88207199403,20cyclictest26-21ksoftirqd/123:00:181
882071994015,9cyclictest26-21ksoftirqd/122:50:331
882071994013,9cyclictest26-21ksoftirqd/119:40:001
88207199401,20cyclictest26-21ksoftirqd/123:15:261
88207199401,19cyclictest26-21ksoftirqd/122:30:151
88206799409,11cyclictest141rcu_preempt20:50:260
88206799408,16cyclictest141rcu_preempt21:15:200
88206799408,11cyclictest141rcu_preempt20:05:250
882067994013,7cyclictest141rcu_preempt19:25:170
882067994012,13cyclictest141rcu_preempt21:35:110
882076993922,5cyclictest42-21ksoftirqd/321:58:273
882076993921,6cyclictest42-21ksoftirqd/319:25:133
882076993916,13cyclictest42-21ksoftirqd/321:00:053
882076993912,5cyclictest141rcu_preempt19:21:373
882076993912,5cyclictest141rcu_preempt19:21:363
88207399392,9cyclictest1753-21gnome-shell20:55:332
88207399392,8cyclictest1753-21gnome-shell22:31:582
88207399392,8cyclictest1753-21gnome-shell20:31:062
882073993921,14cyclictest34-21ksoftirqd/222:51:032
882073993915,8cyclictest985276-40updatedb.mlocat00:00:032
882073993910,11cyclictest34-21ksoftirqd/223:47:122
88207199391,16cyclictest953204-21sshd22:28:031
88206799398,5cyclictest141rcu_preempt23:16:590
88206799396,18cyclictest141rcu_preempt22:05:260
882067993921,13cyclictest986175-21cat00:00:250
882067993913,6cyclictest141rcu_preempt23:25:010
882067993913,6cyclictest141rcu_preempt00:20:290
882067993913,6cyclictest141rcu_preempt00:20:280
882067993911,6cyclictest141rcu_preempt20:35:000
88206799391,11cyclictest920727-21sed20:55:320
882067993911,13cyclictest141rcu_preempt21:00:170
88207699388,6cyclictest141rcu_preempt22:20:013
88207699383,4cyclictest141rcu_preempt19:45:163
882076993822,11cyclictest438-20systemd-journal23:20:593
882076993821,6cyclictest42-21ksoftirqd/322:30:483
882076993821,12cyclictest979286-21ntpq23:40:233
88207399382,8cyclictest1753-21gnome-shell21:47:532
88207399382,8cyclictest1753-21gnome-shell19:10:202
882073993823,11cyclictest964110-21cron23:00:012
882073993817,6cyclictest34-21ksoftirqd/223:14:132
882073993817,6cyclictest34-21ksoftirqd/223:14:132
88207399381,33cyclictest855-21dbus-daemon19:31:562
88207399381,23cyclictest971330-21taskset23:19:482
88207399381,10cyclictest2197014-21PK-Backend22:12:542
882071993818,7cyclictest26-21ksoftirqd/121:30:511
882071993818,7cyclictest26-21ksoftirqd/121:30:501
88206799389,11cyclictest141rcu_preempt20:15:190
882067993814,6cyclictest141rcu_preempt19:30:300
882067993813,6cyclictest141rcu_preempt20:25:190
882067993812,6cyclictest141rcu_preempt19:50:340
882067993811,7cyclictest141rcu_preempt00:15:250
88206799381,14cyclictest0-21swapper/020:40:280
882076993723,10cyclictest916046-21sort20:45:163
882076993718,14cyclictest42-21ksoftirqd/323:45:223
88207399376,17cyclictest1753-21gnome-shell19:51:152
88207399372,7cyclictest955745-21df22:35:142
88207399372,7cyclictest1753-21gnome-shell20:07:392
882073993726,7cyclictest1753-21gnome-shell20:40:102
882073993725,8cyclictest1753-21gnome-shell00:02:302
882073993710,6cyclictest141rcu_preempt22:00:122
882067993726,7cyclictest951627-21cron22:25:000
882067993720,13cyclictest892122-21ntpq19:35:230
882076993619,6cyclictest42-21ksoftirqd/321:30:313
882076993619,6cyclictest42-21ksoftirqd/321:30:313
88207399364,5cyclictest141rcu_preempt21:00:262
88207399362,9cyclictest1753-21gnome-shell22:40:282
88207399362,8cyclictest1753-21gnome-shell21:25:062
882073993625,6cyclictest34-21ksoftirqd/219:36:082
882073993621,11cyclictest886853-21needreboot19:20:252
882073993621,11cyclictest886853-21needreboot19:20:242
88207399361,9cyclictest2197014-21PK-Backend21:20:172
882073993618,13cyclictest1632-21dbus-daemon23:05:022
882073993613,8cyclictest34-21ksoftirqd/220:25:482
882073993611,8cyclictest1753-21gnome-shell19:19:182
882067993613,5cyclictest141rcu_preempt23:00:310
882067993610,7cyclictest141rcu_preempt22:30:250
88207399357,5cyclictest141rcu_preempt00:35:312
88207399357,4cyclictest141rcu_preempt19:30:002
88207399356,5cyclictest141rcu_preempt23:05:222
88207399356,5cyclictest141rcu_preempt22:00:002
88207399352,5cyclictest141rcu_preempt21:50:292
88207399352,5cyclictest141rcu_preempt00:25:152
882073993523,8cyclictest1069-21runrttasks20:47:072
882073993521,9cyclictest1753-21gnome-shell00:07:112
882073993518,13cyclictest970-21ntpd21:35:232
882073993518,13cyclictest34-21ksoftirqd/223:40:012
882073993518,13cyclictest34-21ksoftirqd/223:40:012
882073993513,14cyclictest34-21ksoftirqd/222:24:192
88207399351,10cyclictest141rcu_preempt21:15:332
882073993510,4cyclictest141rcu_preempt21:05:322
88206799355,14cyclictest141rcu_preempt19:10:120
882067993514,6cyclictest141rcu_preempt23:32:360
88207399342,4cyclictest141rcu_preempt00:15:192
882073993418,12cyclictest906348-21cat20:15:312
88207399341,29cyclictest2197014-21PK-Backend22:27:262
88207399341,11cyclictest141rcu_preempt23:32:252
88207399332,5cyclictest141rcu_preempt20:01:152
882073993317,11cyclictest913292-21open_inodes20:35:302
88207399331,11cyclictest141rcu_preempt21:40:222
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional