You are here: Home / Projects / OSADL QA Farm Real-time / Latency plots / 
2023-06-05 - 13:04

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #c, slot #7

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  

x86 Intel Celeron 33455 @1500 MHz, Linux 5.15.2-rt19 (Profile)

Latency plot of shadow in rack #c, slot #7
Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Command line: cyclictest -l100000000 -m -Sp99 -i200 -h400 -q
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the 376 highest latencies:
System rackcslot7s.osadl.org (updated Mon Jun 05, 2023 00:44:53)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
134380222660,15sleep1251rcuc/119:05:271
134474999116101,9cyclictest880966-21IPC0
13447499910980,21cyclictest881262-21Compositor00:10:450
13447499910815,24cyclictest881356-21Isolated14:31:440
13447599910741,26cyclictest0-21swapper/320:35:173
13447599910741,26cyclictest0-21swapper/320:35:173
136613321060,10sleep2881262-21Compositor20:09:442
1344759991052,99cyclictest0-21swapper/321:57:223
1344759991052,99cyclictest0-21swapper/321:57:213
1344753991042,14cyclictest880898-21Xwayland23:44:141
1344753991033,12cyclictest880965-21glean.dispatche20:02:451
13447539910311,88cyclictest880898-21Xwayland21:30:191
13447539910311,88cyclictest880898-21Xwayland21:30:191
1344458210359,14sleep20-21swapper/219:08:162
1344759991023,13cyclictest880726-21firefox23:11:263
13447539910245,8cyclictest880898-21Xwayland00:39:181
1344759991012,94cyclictest880898-21Xwayland22:32:253
13447599910081,11cyclictest881337-21WRRende~ckend#120:34:473
1344757991002,58cyclictest880898-21Xwayland23:07:272
13447539910041,9cyclictest880898-21Xwayland00:33:331
1344753991002,15cyclictest880898-21Xwayland22:29:241
1344749991003,91cyclictest881356-21Isolated14:31:440
1344749991002,93cyclictest880898-21Xwayland22:16:220
134475999993,90cyclictest0-21swapper/322:16:233
134475999992,93cyclictest880898-21Xwayland23:25:433
1344753999977,14cyclictest881253-21Renderer21:40:511
134475399992,92cyclictest880898-21Xwayland23:32:281
134475399992,13cyclictest1339249-21kworker/1:221:46:581
134474999993,12cyclictest881356-21Isolated14:31:440
134475999982,91cyclictest880898-21Xwayland00:29:313
134475399983,91cyclictest0-21swapper/121:50:361
134475399983,86cyclictest880898-21Xwayland20:48:331
134475399983,16cyclictest880966-21IPC1
134475399982,91cyclictest880898-21Xwayland00:01:301
134474999982,91cyclictest1753-21gnome-shell21:57:580
134474999982,91cyclictest1753-21gnome-shell21:57:580
1344759999782,11cyclictest1402296-21timerandwakeup21:50:373
1344753999745,48cyclictest0-21swapper/119:43:131
134475399972,12cyclictest1339249-21kworker/1:222:40:391
1344749999783,9cyclictest881356-21Isolated14:31:440
134474999973,9cyclictest0-21swapper/023:11:260
134474999972,90cyclictest880898-21Xwayland20:31:460
134475999962,90cyclictest880898-21Xwayland23:31:583
134475999962,89cyclictest880898-21Xwayland21:23:503
134475999962,89cyclictest880898-21Xwayland20:54:323
1344753999687,5cyclictest231irq_work/120:35:461
1344753999687,5cyclictest231irq_work/120:35:461
134475399962,9cyclictest1339249-21kworker/1:200:23:161
134475399962,8cyclictest0-21swapper/119:37:431
134475399962,85cyclictest1339249-21kworker/1:221:15:591
134475399962,84cyclictest26-21ksoftirqd/121:37:211
134475399962,11cyclictest1339249-21kworker/1:221:00:581
1344749999684,9cyclictest880898-21Xwayland19:37:420
134474999962,90cyclictest1427279-21kworker/0:123:25:430
1344759999584,7cyclictest961-21snmpd19:59:143
1344759999581,8cyclictest881356-21Isolated14:31:443
134475999953,14cyclictest1445826-21strings23:55:303
134475999952,89cyclictest880898-21Xwayland20:13:453
134475999952,89cyclictest880898-21Xwayland20:13:453
1344759999519,55cyclictest141rcu_preempt19:54:443
1344753999584,7cyclictest1339249-21kworker/1:200:29:581
134475399952,9cyclictest1339249-21kworker/1:219:54:581
134475399952,89cyclictest1339249-21kworker/1:219:15:591
134475399952,88cyclictest1382278-21/usr/sbin/munin20:55:171
134475399952,84cyclictest880898-21Xwayland21:58:441
134475399952,84cyclictest880898-21Xwayland21:58:431
134475399952,11cyclictest1339249-21kworker/1:223:04:581
1344749999588,5cyclictest0-21swapper/023:57:300
1344759999484,5cyclictest0-21swapper/321:15:583
1344759999435,16cyclictest881337-21WRRende~ckend#122:43:553
134475999942,89cyclictest880898-21Xwayland23:20:423
134475399943,87cyclictest26-21ksoftirqd/123:06:581
134475399942,88cyclictest880898-21Xwayland22:39:391
134475399942,88cyclictest1339249-21kworker/1:223:57:581
134475399942,88cyclictest0-21swapper/120:27:461
134475399942,88cyclictest0-21swapper/100:17:311
134475399941,13cyclictest880898-21Xwayland21:28:491
134474999943,88cyclictest0-21swapper/020:13:450
134474999943,88cyclictest0-21swapper/020:13:450
134474999943,87cyclictest0-21swapper/023:31:580
134474999942,8cyclictest0-21swapper/020:17:310
134474999942,7cyclictest0-21swapper/022:32:250
134421129458,28sleep00-21swapper/019:05:410
134475999933,87cyclictest0-21swapper/320:46:463
134475999932,9cyclictest880898-21Xwayland20:28:303
134475999932,88cyclictest0-21swapper/323:54:593
1344757999321,16cyclictest881356-21Isolated14:31:442
1344753999385,5cyclictest231irq_work/100:12:591
1344753999384,5cyclictest0-21swapper/119:32:121
134475399934,83cyclictest881356-21Isolated14:31:441
134475399932,9cyclictest0-21swapper/121:12:191
134475399932,87cyclictest1339249-21kworker/1:223:51:591
134475399932,87cyclictest1339249-21kworker/1:222:57:591
134474999932,87cyclictest880898-21Xwayland00:26:310
134474999932,87cyclictest0-21swapper/020:54:330
134474999932,7cyclictest0-21swapper/019:47:440
134474999932,7cyclictest0-21swapper/019:47:440
134475999922,86cyclictest0-21swapper/300:19:323
1344757999229,53cyclictest881253-21Renderer21:34:512
1344757999229,53cyclictest881253-21Renderer21:34:512
1344753999284,5cyclictest0-21swapper/123:28:131
134475399922,86cyclictest0-21swapper/119:59:141
1344749999283,6cyclictest0-21swapper/019:31:580
1344749999282,6cyclictest0-21swapper/021:15:590
134474999922,87cyclictest0-21swapper/023:23:570
13714162910,7sleep1881369-21Timer20:25:021
1344759999179,7cyclictest1395450-21users21:30:353
1344759999179,7cyclictest1395450-21users21:30:343
134475999912,86cyclictest0-21swapper/322:47:403
1344757999129,52cyclictest881253-21Renderer22:36:392
1344753999184,4cyclictest1339249-21kworker/1:223:24:591
134475399914,13cyclictest881356-21Isolated14:31:441
134475399914,13cyclictest881356-21Isolated14:31:441
134475399912,83cyclictest880965-21glean.dispatche22:49:551
134475399912,7cyclictest0-21swapper/121:09:031
134475399912,79cyclictest881253-21Renderer22:08:531
1344749999183,5cyclictest0-21swapper/021:53:590
1344749999183,5cyclictest0-21swapper/000:23:170
134474999913,84cyclictest0-21swapper/022:21:530
134474999912,85cyclictest0-21swapper/019:53:140
134474999912,6cyclictest0-21swapper/020:28:310
134444929157,26sleep30-21swapper/319:08:093
134475999903,83cyclictest0-21swapper/300:30:583
134475999902,8cyclictest0-21swapper/321:36:203
134475999902,85cyclictest0-21swapper/322:27:533
134475999902,84cyclictest0-21swapper/319:41:423
134475399902,84cyclictest0-21swapper/120:50:481
1344749999082,5cyclictest0-21swapper/020:04:580
1344749999081,6cyclictest0-21swapper/023:04:590
1344749999081,5cyclictest0-21swapper/022:42:590
1344749999080,6cyclictest0-21swapper/021:12:180
1344749999079,8cyclictest880898-21Xwayland20:38:320
1344749999079,8cyclictest880898-21Xwayland20:38:320
1344749999077,8cyclictest881356-21Isolated14:31:440
134474999902,85cyclictest0-21swapper/021:36:200
134474999902,85cyclictest0-21swapper/021:07:580
1344759998981,5cyclictest0-21swapper/320:55:183
134475999892,8cyclictest0-21swapper/322:21:533
134475999892,8cyclictest0-21swapper/321:07:593
1344753998981,5cyclictest1339249-21kworker/1:222:50:591
134475399892,83cyclictest1339249-21kworker/1:222:11:581
1344749998981,5cyclictest0-21swapper/023:48:140
1344749998980,6cyclictest13-21ksoftirqd/020:43:580
1344749998977,8cyclictest1382138-21/usr/sbin/munin20:55:180
1344749998976,9cyclictest880898-21Xwayland00:17:320
134475999882,83cyclictest0-21swapper/300:11:303
134475999882,82cyclictest0-21swapper/322:10:593
134475999882,82cyclictest0-21swapper/300:22:473
134475399884,74cyclictest881337-21WRRende~ckend#123:46:141
1344749998881,4cyclictest0-21swapper/000:36:580
1344759998780,4cyclictest0-21swapper/319:16:593
1344759998779,5cyclictest0-21swapper/320:43:583
1344759998779,5cyclictest0-21swapper/300:01:303
134475999872,81cyclictest0-21swapper/319:23:573
134475399879,74cyclictest26-21ksoftirqd/100:06:461
1344753998774,8cyclictest880966-21IPC1
1344753998716,66cyclictest880974-21IPDL14:31:441
1344749998779,5cyclictest0-21swapper/021:00:590
1344749998779,5cyclictest0-21swapper/000:31:020
1344759998679,4cyclictest0-21swapper/321:28:203
1344759998678,5cyclictest0-21swapper/323:02:593
1344759998613,23cyclictest141rcu_preempt23:19:273
134475799863,49cyclictest881356-21Isolated14:31:442
1344753998623,56cyclictest881253-21Renderer23:37:581
1344749998677,5cyclictest0-21swapper/019:16:590
1344753998576,6cyclictest0-21swapper/123:19:591
134475399852,79cyclictest0-21swapper/120:34:471
1344749998578,4cyclictest0-21swapper/023:44:580
134474999853,10cyclictest0-21swapper/022:10:380
13865302840,4chrt1385657-21/usr/sbin/munin21:05:322
1344759998477,5cyclictest0-21swapper/322:57:583
134475799842,23cyclictest1389156-21apt21:15:182
134475399847,73cyclictest26-21ksoftirqd/120:10:451
134475399847,73cyclictest26-21ksoftirqd/120:10:441
1344753998425,50cyclictest881337-21WRRende~ckend#122:18:381
1344749998476,5cyclictest0-21swapper/023:51:590
1344749998476,5cyclictest0-21swapper/000:01:300
162399830,5rtkit-daemon0-21swapper/021:45:230
1344759998375,5cyclictest0-21swapper/322:39:403
1344759998375,5cyclictest0-21swapper/320:03:293
134475999833,8cyclictest0-21swapper/321:14:183
134475399834,70cyclictest881356-21Isolated14:31:441
1344749998375,5cyclictest0-21swapper/021:30:350
1344749998375,5cyclictest0-21swapper/021:30:340
1344749998374,5cyclictest0-21swapper/022:57:590
134474999833,76cyclictest0-21swapper/022:47:100
134474999833,76cyclictest0-21swapper/021:40:060
1344759998275,4cyclictest0-21swapper/321:45:593
134475999823,75cyclictest0-21swapper/321:04:043
134475999822,9cyclictest0-21swapper/321:40:053
134475999822,76cyclictest0-21swapper/323:37:143
134475999822,76cyclictest0-21swapper/322:04:223
134475799823,14cyclictest881356-21Isolated14:31:442
1344757998228,47cyclictest881253-21Renderer22:16:532
134475399821,75cyclictest881253-21Renderer22:32:091
134474999823,74cyclictest1432077-21find23:15:420
134474999823,74cyclictest0-21swapper/022:28:080
1344759998173,5cyclictest0-21swapper/323:06:593
134475799819,48cyclictest881253-21Renderer23:30:122
1344757998170,6cyclictest0-21swapper/220:39:322
1344757998170,6cyclictest0-21swapper/220:39:312
1344757998112,46cyclictest881364-21IPC2
1344753998172,6cyclictest0-21swapper/121:24:051
1344749998172,6cyclictest0-21swapper/022:39:400
134474999812,75cyclictest0-21swapper/023:37:130
134474999812,75cyclictest0-21swapper/022:53:100
134474999812,74cyclictest0-21swapper/021:23:050
134475999802,8cyclictest0-21swapper/322:53:103
134475999802,7cyclictest0-21swapper/320:16:313
134475999802,74cyclictest0-21swapper/300:38:023
134475999802,73cyclictest0-21swapper/319:45:443
134475999802,73cyclictest0-21swapper/319:45:433
134475799802,19cyclictest881253-21Renderer21:38:512
134475399802,74cyclictest0-21swapper/119:26:411
134475399802,74cyclictest0-21swapper/119:22:271
134475399802,68cyclictest0-21swapper/122:23:541
1344749998072,5cyclictest0-21swapper/019:40:570
134474999802,8cyclictest0-21swapper/000:05:150
1344759997971,5cyclictest0-21swapper/319:32:433
134475999792,74cyclictest0-21swapper/319:12:403
134475999792,73cyclictest0-21swapper/319:36:583
134475399792,7cyclictest0-21swapper/122:02:081
134474999793,72cyclictest0-21swapper/022:07:530
134474999793,72cyclictest0-21swapper/019:27:570
1344759997870,5cyclictest0-21swapper/320:22:303
1344759997869,6cyclictest1446876-21kworker/3:100:08:583
134475999783,8cyclictest0-21swapper/322:06:533
1344757997837,12cyclictest881356-21Isolated14:31:442
1344749997871,4cyclictest0-21swapper/020:47:320
1344749997869,5cyclictest0-21swapper/023:06:590
134475999772,72cyclictest0-21swapper/319:27:573
1344749997768,6cyclictest0-21swapper/022:00:070
1344757997633,12cyclictest881331-21Privileged14:31:442
1344757997633,12cyclictest881331-21Privileged14:31:442
1344759997567,5cyclictest0-21swapper/323:46:293
134475799753,45cyclictest1753-21gnome-shell19:48:582
134475799753,45cyclictest1753-21gnome-shell19:48:582
14510262730,8sleep2331rcuc/200:10:342
1344759997365,5cyclictest0-21swapper/320:07:593
1344757997360,8cyclictest880966-21IPC2
134475799733,25cyclictest881253-21Renderer23:10:572
1344757997213,14cyclictest881337-21WRRende~ckend#120:34:162
134475799713,64cyclictest0-21swapper/220:53:172
1344757997011,14cyclictest881253-21Renderer20:40:472
1344757996918,46cyclictest881356-21Isolated14:31:442
1344757996918,46cyclictest881356-21Isolated14:31:442
134475799683,55cyclictest881253-21Renderer22:43:552
134475799683,24cyclictest0-21swapper/222:57:402
134475799682,55cyclictest1753-21gnome-shell20:22:592
1344757996825,5cyclictest0-21swapper/221:40:202
134475799674,17cyclictest881356-21Isolated14:31:442
134475799667,6cyclictest141rcu_preempt22:10:532
134475799664,17cyclictest881356-21Isolated14:31:442
134475799662,25cyclictest881356-21Isolated14:31:442
134475799658,13cyclictest881253-21Renderer19:15:402
134475799656,52cyclictest881364-21IPC2
134475799656,51cyclictest880898-21Xwayland21:50:372
134475799654,16cyclictest1753-21gnome-shell19:12:592
134475799653,54cyclictest880898-21Xwayland20:55:472
134475799653,54cyclictest880898-21Xwayland19:59:442
134475799653,16cyclictest881253-21Renderer00:08:462
1344757996523,10cyclictest141rcu_preempt23:55:302
1344757996513,12cyclictest881337-21WRRende~ckend#121:03:192
134475799644,15cyclictest881356-21Isolated14:31:442
134475799643,52cyclictest881356-21Isolated14:31:442
1344757996410,11cyclictest881356-21Isolated14:31:442
1344757996336,19cyclictest881337-21WRRende~ckend#120:16:302
134475799633,51cyclictest1753-21gnome-shell23:25:582
134475799633,17cyclictest880898-21Xwayland19:50:442
134475799632,7cyclictest141rcu_preempt00:24:162
134475799632,16cyclictest881253-21Renderer00:39:472
134475799632,16cyclictest881253-21Renderer00:17:462
134475799623,50cyclictest880898-21Xwayland22:33:392
134475799623,15cyclictest1753-21gnome-shell00:31:592
134475799622,17cyclictest881253-21Renderer23:38:442
134475799613,53cyclictest880898-21Xwayland21:45:202
134475799613,50cyclictest880898-21Xwayland22:26:382
1344757996046,9cyclictest880965-21glean.dispatche21:27:342
162399590,9rtkit-daemon1622-21rtkit-daemon22:21:342
162399590,6rtkit-daemon1622-21rtkit-daemon23:04:092
1344757995940,12cyclictest1753-21gnome-shell21:13:442
134475799582,13cyclictest880898-21Xwayland20:45:322
134475799573,11cyclictest881356-21Isolated14:31:442
134475799562,12cyclictest1753-21gnome-shell00:02:592
134475799542,46cyclictest881253-21Renderer00:30:022
1344757995238,8cyclictest880966-21IPC2
1344757995225,17cyclictest881356-21Isolated14:31:442
134475799513,8cyclictest0-21swapper/223:46:282
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional