You are here: Home / Projects / OSADL QA Farm Real-time / Latency plots / 
2024-07-16 - 13:58

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #c, slot #7

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of all highest latencies:
System rackcslot7s.osadl.org (updated Mon Jul 15, 2024 12:44:54)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
77799699508499,6cyclictest854536-21turbostat10:10:013
77799699504496,5cyclictest890626-21turbostat11:54:563
77799699504496,5cyclictest863456-21turbostat10:35:013
77799699475452,20cyclictest881732-21turbostat11:25:013
77799699467449,15cyclictest856311-21turbostat10:19:543
77798299465456,6cyclictest885279-21turbostat11:39:540
77799699464455,6cyclictest849191-21turbostat09:59:543
77799699464442,19cyclictest888855-21turbostat11:49:563
77799699462455,4cyclictest867124-21turbostat10:49:543
77799699462455,4cyclictest852763-21turbostat10:05:013
77799699456449,4cyclictest872612-21turbostat11:00:013
77799699456449,4cyclictest833148-21turbostat09:09:593
77799699452444,5cyclictest834926-21turbostat09:15:013
77799299452445,4cyclictest868902-21turbostat10:54:542
77799699451442,6cyclictest899551-21turbostat12:15:013
77799699449440,6cyclictest865337-21turbostat10:40:013
77799699449440,6cyclictest865337-21turbostat10:40:003
77799299445438,4cyclictest825869-21turbostat08:54:562
77799699442433,6cyclictest894199-21turbostat12:00:003
77799699441433,5cyclictest836712-21turbostat09:24:563
77799699440433,4cyclictest867124-21turbostat10:44:593
77799699439419,17cyclictest843854-21turbostat09:40:003
77799699439416,19cyclictest876247-21turbostat11:09:593
77798799436428,4cyclictest863456-21turbostat10:39:551
77798799436428,4cyclictest863456-21turbostat10:39:551
77799699434425,5cyclictest820485-21turbostat08:35:003
77799699433422,7cyclictest840273-21turbostat09:29:593
77799699428420,5cyclictest843854-21turbostat09:44:563
77799699426419,4cyclictest858088-21turbostat10:24:543
77799699425418,4cyclictest840273-21turbostat09:34:543
77799699424417,4cyclictest827799-21turbostat08:59:563
77799299424417,4cyclictest881732-21turbostat11:29:562
77799699423401,19cyclictest824089-21turbostat08:44:593
77799299423415,5cyclictest892412-21turbostat11:59:562
77798299420413,4cyclictest859884-21turbostat10:29:560
77798299419412,4cyclictest878033-21turbostat11:19:550
77799299418409,6cyclictest887060-21turbostat11:44:542
77799699416409,4cyclictest903113-21turbostat12:29:553
77799699416409,4cyclictest903113-21turbostat12:29:553
77799699415408,4cyclictest836712-21turbostat09:20:013
77799699407398,6cyclictest822309-21turbostat08:39:593
77799699402395,4cyclictest897748-21turbostat12:09:593
77799699402383,15cyclictest908454-21turbostat12:40:013
77799299399371,25cyclictest834926-21turbostat09:19:552
77799299398391,4cyclictest829585-21turbostat09:04:562
77799699397390,4cyclictest878033-21turbostat11:14:593
77799699397388,6cyclictest824089-21turbostat08:49:553
77799699396389,4cyclictest818713-21turbostat08:30:013
77799699392385,4cyclictest874475-21turbostat11:05:013
77799699387380,4cyclictest885279-21turbostat11:34:593
77799699387380,4cyclictest885279-21turbostat11:34:593
77799699387380,4cyclictest856311-21turbostat10:15:003
77799699387380,4cyclictest856311-21turbostat10:14:593
77799699385367,15cyclictest895972-21turbostat12:04:593
77799699372366,4cyclictest827799-21turbostat08:55:013
77799699372366,3cyclictest901323-21turbostat12:24:553
77799699370362,5cyclictest847401-21turbostat09:50:003
77799699370362,5cyclictest847401-21turbostat09:50:003
77799299368360,5cyclictest876247-21turbostat11:14:542
77799699366357,6cyclictest879826-21turbostat11:20:003
77799699361354,4cyclictest899551-21turbostat12:19:563
77799699356348,5cyclictest861663-21turbostat10:30:013
77799699355347,5cyclictest870697-21turbostat10:55:013
77799699343335,5cyclictest847401-21turbostat09:54:543
77799299334327,4cyclictest904890-21turbostat12:34:542
77799699332325,4cyclictest887060-21turbostat11:39:593
77799699324318,3cyclictest888855-21turbostat11:45:013
77799699320313,4cyclictest831369-21turbostat09:04:593
77799699319312,4cyclictest883509-21turbostat11:30:013
77799299317310,4cyclictest872612-21turbostat11:04:562
77798299201188,10cyclictest731313-21kworker/0:208:29:300
89250821180,3sleep10-21swapper/111:55:011
88063821130,6sleep20-21swapper/211:20:252
7779969910291,8cyclictest906662-21turbostat12:34:593
8302802990,4chrt830273-21idleruntime09:00:261
77721729859,33sleep10-21swapper/107:06:441
77776729571,17sleep30-21swapper/307:09:163
77722728765,14sleep00-21swapper/007:06:510
77720628361,14sleep20-21swapper/207:06:382
77798299702,19cyclictest1787-21gdbus08:20:300
162399610,10rtkit-daemon1622-21rtkit-daemon10:52:121
777987996024,15cyclictest141rcu_preempt08:25:191
162399590,9rtkit-daemon1622-21rtkit-daemon07:48:350
162399590,9rtkit-daemon1622-21rtkit-daemon07:48:350
777992995836,14cyclictest34-21ksoftirqd/208:27:212
777982995821,21cyclictest13-21ksoftirqd/010:36:380
777982995821,21cyclictest13-21ksoftirqd/010:36:380
162399580,48rtkit-daemon3765849-21Timer11:10:131
77799299571,11cyclictest1753-21gnome-shell07:57:592
77798299572,11cyclictest13-21ksoftirqd/011:02:570
162399570,8rtkit-daemon1622-21rtkit-daemon08:56:290
77799699562,8cyclictest3765663-21gnome-terminal-07:57:593
777987995517,6cyclictest777975-21cyclictest08:23:351
77798799550,50cyclictest1622-21rtkit-daemon11:25:201
162399550,9rtkit-daemon1622-21rtkit-daemon12:27:090
162399550,9rtkit-daemon1622-21rtkit-daemon12:27:090
777982995419,19cyclictest13-21ksoftirqd/012:35:000
777982995415,19cyclictest13-21ksoftirqd/008:35:000
162399540,8rtkit-daemon1622-21rtkit-daemon10:34:431
162399540,8rtkit-daemon1622-21rtkit-daemon07:33:070
77799699533,9cyclictest3765663-21gnome-terminal-07:18:583
777996995337,12cyclictest1753-21gnome-shell07:35:593
77799299531,10cyclictest1753-21gnome-shell07:44:592
77798799530,49cyclictest1622-21rtkit-daemon09:06:021
77798799530,49cyclictest1622-21rtkit-daemon07:27:471
777982995317,20cyclictest13-21ksoftirqd/008:38:520
162399530,9rtkit-daemon1622-21rtkit-daemon07:14:540
162399530,8rtkit-daemon1622-21rtkit-daemon11:07:540
9037242520,4sleep20-21swapper/212:25:182
9037242520,4sleep20-21swapper/212:25:172
777992995234,7cyclictest34-21ksoftirqd/208:20:502
77799299522,45cyclictest1753-21gnome-shell08:05:592
77799299521,46cyclictest1753-21gnome-shell08:19:582
162399520,43rtkit-daemon3765600-21Timer12:17:450
777996995118,11cyclictest790190-21sh07:40:373
77798299516,40cyclictest1753-21gnome-shell07:19:590
777992995038,8cyclictest1753-21gnome-shell07:34:592
777982995014,19cyclictest13-21ksoftirqd/010:05:020
8388182490,5sleep10-21swapper/109:25:131
777996994937,8cyclictest1753-21gnome-shell08:04:593
77799699492,43cyclictest0-21swapper/307:14:583
777996994914,14cyclictest807697-21scp08:22:183
77798299492,6cyclictest0-21swapper/008:07:580
777982994912,20cyclictest13-21ksoftirqd/007:55:000
777992994831,12cyclictest1753-21gnome-shell07:48:592
777992994831,12cyclictest1753-21gnome-shell07:48:582
777987994816,6cyclictest777975-21cyclictest09:00:011
777987994814,5cyclictest141rcu_preempt09:50:001
777987994814,5cyclictest141rcu_preempt09:50:001
77798299484,18cyclictest3765717-21top12:22:020
777982994816,18cyclictest13-21ksoftirqd/010:55:010
777982994813,19cyclictest13-21ksoftirqd/011:50:010
777982994811,20cyclictest13-21ksoftirqd/011:20:500
77798299480,45cyclictest1622-21rtkit-daemon09:13:500
77799699472,5cyclictest0-21swapper/308:06:583
77799299472,5cyclictest0-21swapper/207:22:582
777987994739,5cyclictest3765663-21gnome-terminal-07:44:591
77798799472,5cyclictest0-21swapper/108:11:591
77798799472,5cyclictest0-21swapper/108:11:591
777982994726,17cyclictest855-21dbus-daemon09:50:010
777982994726,17cyclictest855-21dbus-daemon09:50:000
777982994711,19cyclictest13-21ksoftirqd/009:30:140
77799299462,41cyclictest0-21swapper/208:04:592
77799299462,41cyclictest0-21swapper/207:35:592
777987994638,5cyclictest26-21ksoftirqd/107:55:581
77798799462,42cyclictest0-21swapper/107:51:581
77798299461,13cyclictest791145-21apt-config07:45:010
162399460,38rtkit-daemon788342-21ntp_states07:35:331
8790242450,6chrt0-21swapper/211:15:302
8714822450,13sleep1777975-21cyclictest10:55:241
8194012450,4sleep10-21swapper/108:30:231
777996994524,15cyclictest792656-21taskset07:47:593
777996994524,15cyclictest792656-21taskset07:47:583
77799699452,40cyclictest0-21swapper/307:21:593
777992994525,16cyclictest34-21ksoftirqd/212:15:002
777992994514,6cyclictest141rcu_preempt08:40:452
77798299459,21cyclictest13-21ksoftirqd/009:20:010
77798299458,20cyclictest13-21ksoftirqd/011:55:360
777982994511,18cyclictest13-21ksoftirqd/010:25:010
8717322440,4sleep20-21swapper/210:55:292
777987994424,15cyclictest853791-21ntp_states10:05:351
777987994413,12cyclictest141rcu_preempt09:20:121
77798299449,18cyclictest13-21ksoftirqd/010:55:160
77798299447,18cyclictest13-21ksoftirqd/011:30:020
777982994411,19cyclictest13-21ksoftirqd/009:30:000
162399440,34rtkit-daemon3765403-21firefox10:41:160
777992994324,6cyclictest34-21ksoftirqd/211:36:112
777992994318,21cyclictest794693-21awk07:54:592
77798799439,13cyclictest141rcu_preempt07:15:401
777987994314,14cyclictest141rcu_preempt09:55:021
777987994314,12cyclictest141rcu_preempt08:40:341
777987994313,12cyclictest141rcu_preempt09:40:011
777987994312,12cyclictest141rcu_preempt08:15:341
777987994311,12cyclictest141rcu_preempt08:35:401
77798299437,20cyclictest13-21ksoftirqd/007:55:340
77798299436,20cyclictest13-21ksoftirqd/008:40:280
77798299436,19cyclictest13-21ksoftirqd/010:47:020
77798299435,9cyclictest13-21ksoftirqd/012:15:010
777982994318,21cyclictest1068-21gdbus09:21:570
777982994313,17cyclictest13-21ksoftirqd/012:40:010
777982994312,18cyclictest13-21ksoftirqd/008:50:020
77798299431,14cyclictest13-21ksoftirqd/007:20:320
8413042420,5sleep10-21swapper/109:30:331
777992994236,4cyclictest0-21swapper/207:27:582
777992994222,7cyclictest34-21ksoftirqd/209:25:372
777987994227,11cyclictest835559-21sh09:15:161
777987994226,12cyclictest901317-21cron12:20:001
777987994225,13cyclictest903094-21cron12:25:001
777987994224,14cyclictest827401-21nice08:51:121
777987994210,12cyclictest141rcu_preempt12:06:491
777987994210,12cyclictest141rcu_preempt10:45:301
77798299429,18cyclictest13-21ksoftirqd/011:45:020
77798299428,18cyclictest13-21ksoftirqd/008:20:020
77798299426,9cyclictest13-21ksoftirqd/009:40:300
77798299426,15cyclictest0-21swapper/007:28:160
77798299425,20cyclictest13-21ksoftirqd/010:10:150
77798299425,20cyclictest13-21ksoftirqd/010:10:140
77798299423,16cyclictest13-21ksoftirqd/009:57:080
777982994219,9cyclictest13-21ksoftirqd/010:30:330
777982994211,13cyclictest13-21ksoftirqd/009:01:070
8411492410,6chrt0-21swapper/209:30:302
77799699411,35cyclictest1753-21gnome-shell08:14:583
77799699411,35cyclictest1753-21gnome-shell08:14:583
77799299414,11cyclictest141rcu_preempt10:25:352
777992994121,6cyclictest34-21ksoftirqd/210:48:132
77799299411,17cyclictest8193922idleruntime08:30:232
77798799419,12cyclictest141rcu_preempt11:30:141
77798799419,12cyclictest141rcu_preempt11:30:131
77798799418,13cyclictest141rcu_preempt12:00:261
777987994123,13cyclictest799241-21ntp_kernel_pll_08:05:301
777987994117,6cyclictest141rcu_preempt09:40:191
777987994116,6cyclictest141rcu_preempt08:00:341
777987994113,6cyclictest141rcu_preempt12:30:021
777987994113,6cyclictest141rcu_preempt12:30:011
777987994112,11cyclictest141rcu_preempt10:20:021
777987994111,14cyclictest141rcu_preempt07:10:181
77798299418,18cyclictest13-21ksoftirqd/008:55:020
777982994135,4cyclictest0-21swapper/008:12:590
777982994135,4cyclictest0-21swapper/008:12:580
777982994123,13cyclictest849052-21Backgro~ol0
77798299412,15cyclictest13-21ksoftirqd/010:05:170
77798299412,11cyclictest13-21ksoftirqd/011:35:010
77798299412,11cyclictest13-21ksoftirqd/011:35:010
777996994012,6cyclictest0-21swapper/307:29:223
777992994023,6cyclictest34-21ksoftirqd/208:37:042
777992994020,13cyclictest34-21ksoftirqd/210:36:382
777992994020,13cyclictest34-21ksoftirqd/210:36:382
77798799409,12cyclictest141rcu_preempt10:13:211
77798799409,12cyclictest141rcu_preempt10:13:211
77798799406,13cyclictest141rcu_preempt11:05:181
777987994015,6cyclictest141rcu_preempt11:55:401
777987994015,6cyclictest141rcu_preempt07:30:221
777987994015,12cyclictest141rcu_preempt11:40:001
777987994014,12cyclictest141rcu_preempt12:10:131
777987994013,12cyclictest141rcu_preempt09:55:111
777987994012,12cyclictest141rcu_preempt07:20:331
77798799401,20cyclictest851823-21cat10:00:291
777987994010,12cyclictest141rcu_preempt10:25:131
77798299405,19cyclictest13-21ksoftirqd/010:15:290
77798299403,20cyclictest13-21ksoftirqd/009:40:010
77798299402,8cyclictest895224-21ntp_states12:00:320
9079652390,4sleep20-21swapper/212:35:402
8626902390,5sleep20-21swapper/210:30:342
777992993932,4cyclictest0-21swapper/207:16:582
777992993923,12cyclictest856313-21perf10:15:002
777992993923,12cyclictest856313-21perf10:15:002
77798799399,11cyclictest141rcu_preempt07:48:581
77798799399,11cyclictest141rcu_preempt07:48:581
77798799398,13cyclictest141rcu_preempt11:20:261
77798799397,12cyclictest141rcu_preempt10:20:161
777987993912,12cyclictest141rcu_preempt08:50:001
777987993912,10cyclictest141rcu_preempt10:40:151
777987993911,6cyclictest141rcu_preempt11:02:561
777987993911,12cyclictest141rcu_preempt09:12:001
77798299394,20cyclictest13-21ksoftirqd/011:53:460
777982993914,9cyclictest13-21ksoftirqd/012:05:150
77798299391,22cyclictest831625-21seq09:05:110
777996993824,10cyclictest1753-21gnome-shell08:18:593
777996993822,12cyclictest42-21ksoftirqd/307:54:383
777996993821,12cyclictest438-20systemd-journal07:35:003
77799299382,6cyclictest141rcu_preempt09:15:002
77799299382,31cyclictest897391-21StreamT~2
777992993821,6cyclictest34-21ksoftirqd/207:12:442
777992993818,13cyclictest34-21ksoftirqd/210:09:402
777987993812,12cyclictest141rcu_preempt12:30:341
777987993811,12cyclictest141rcu_preempt11:45:141
777987993810,12cyclictest141rcu_preempt11:40:141
77798299383,11cyclictest13-21ksoftirqd/008:00:390
777982993821,13cyclictest876523-21dpkg11:10:110
77798299381,16cyclictest3765876-21Isolated14:31:440
777992993721,12cyclictest895197-21ntpq12:00:312
777992993721,12cyclictest855-21dbus-daemon08:15:012
777992993721,12cyclictest855-21dbus-daemon08:15:002
777992993720,6cyclictest34-21ksoftirqd/211:54:562
77799299371,5cyclictest141rcu_preempt09:20:302
777987993712,11cyclictest141rcu_preempt11:15:161
777992993622,10cyclictest833138-21perf09:09:592
777992993621,6cyclictest34-21ksoftirqd/209:50:582
777992993620,12cyclictest844841-21ntpq09:40:292
777992993619,6cyclictest34-21ksoftirqd/209:58:502
777992993619,12cyclictest438-20systemd-journal10:41:012
77799299361,11cyclictest141rcu_preempt11:08:532
77798799369,5cyclictest141rcu_preempt12:35:391
777992993523,9cyclictest850589-21kworker/u8:310:01:212
777992993523,7cyclictest3765717-21top12:19:052
777992993520,11cyclictest889762-21sed11:45:252
777992993520,10cyclictest825972-21gdbus08:50:012
777992993519,11cyclictest901718-21grep12:20:132
777992993517,13cyclictest3765603-21IPDL14:31:442
777992993517,13cyclictest3765603-21IPDL14:31:442
777992993515,15cyclictest3765894-21IPC2
777992993422,9cyclictest825842-21kworker/u8:208:55:062
777992993417,12cyclictest857451-21cut10:15:372
777992993415,14cyclictest3765600-21Timer09:45:502
777992993415,14cyclictest3765600-21Timer09:45:492
77799299331,11cyclictest141rcu_preempt10:20:252
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional