You are here: Home / Projects / OSADL QA Farm Real-time / Latency plots / 
2023-12-01 - 00:55

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #e, slot #3

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.

Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes
Compare latency of primary with shadow system
Characteristics of the 792 highest latencies:
System rackeslot3s.osadl.org (updated Thu Nov 30, 2023 12:45:04)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
1988498998177,2cyclictest0-21swapper/010:00:020
1988498998076,2cyclictest0-21swapper/008:10:020
1988498996925,11cyclictest12-21ksoftirqd/009:40:000
1988498996710,6cyclictest131rcu_preempt10:17:270
198849899662,13cyclictest12-21ksoftirqd/007:10:000
198850399653,41cyclictest23-21ksoftirqd/108:30:021
198849899638,6cyclictest131rcu_preempt10:10:010
198849899629,7cyclictest131rcu_preempt11:20:000
198849899622,7cyclictest121ksoftirqd/010:50:020
1988508996120,22cyclictest1988490-21cyclictest09:05:023
1988508996120,22cyclictest1988490-21cyclictest09:05:023
198850399617,10cyclictest23-21ksoftirqd/111:10:021
198850399617,10cyclictest23-21ksoftirqd/111:10:021
198850399605,9cyclictest23-21ksoftirqd/111:20:011
1988503996017,12cyclictest23-21ksoftirqd/109:10:001
1988503996015,6cyclictest131rcu_preempt07:50:001
1988503996014,12cyclictest23-21ksoftirqd/110:50:011
198850399601,10cyclictest23-21ksoftirqd/107:35:021
1988508995838,15cyclictest1-21systemd11:50:013
198850599586,6cyclictest131rcu_preempt09:35:012
1988498995818,6cyclictest131rcu_preempt08:40:010
1988498995812,5cyclictest131rcu_preempt10:15:010
198850399576,10cyclictest23-21ksoftirqd/112:30:011
1988503995719,11cyclictest23-21ksoftirqd/112:05:011
1988503995719,11cyclictest23-21ksoftirqd/112:05:011
1988503995712,14cyclictest23-21ksoftirqd/110:15:011
1988503995710,5cyclictest131rcu_preempt07:30:011
198849899579,6cyclictest131rcu_preempt09:09:590
1988498995717,8cyclictest151rcuc/012:35:020
1988498995711,6cyclictest131rcu_preempt11:25:000
1988498995710,6cyclictest131rcu_preempt11:55:000
198850399566,9cyclictest23-21ksoftirqd/108:13:041
1988503995612,5cyclictest131rcu_preempt11:05:001
1988503995611,6cyclictest131rcu_preempt10:00:011
198849899565,32cyclictest131rcu_preempt09:25:020
1988505995538,12cyclictest274-21dbus-daemon08:00:002
1988505995537,14cyclictest235-21systemd-journal09:10:002
198850399555,7cyclictest23-21ksoftirqd/112:20:011
1988503995536,15cyclictest274-21dbus-daemon08:40:001
1988503995518,9cyclictest23-21ksoftirqd/108:25:011
198850399551,7cyclictest23-21ksoftirqd/111:50:001
1988503995513,7cyclictest131rcu_preempt11:45:021
1988503995512,6cyclictest131rcu_preempt09:30:021
1988498995519,5cyclictest131rcu_preempt09:00:010
1988498995517,33cyclictest1989796-21grep07:35:020
1988498995515,11cyclictest12-21ksoftirqd/009:30:020
1988498995512,5cyclictest131rcu_preempt10:05:020
198850399545,13cyclictest23-21ksoftirqd/110:45:021
1988503995419,6cyclictest131rcu_preempt11:35:011
1988503995416,9cyclictest131rcu_preempt07:25:021
1988503995414,5cyclictest131rcu_preempt07:55:031
1988503995411,11cyclictest23-21ksoftirqd/112:25:001
1988503995410,5cyclictest131rcu_preempt10:35:021
198849899546,6cyclictest131rcu_preempt12:10:020
1988498995425,7cyclictest12-21ksoftirqd/012:20:010
1988498995413,9cyclictest131rcu_preempt11:05:000
198850399538,5cyclictest131rcu_preempt09:15:021
198850399537,6cyclictest131rcu_preempt10:20:011
198850399537,21cyclictest23-21ksoftirqd/109:40:011
198850399535,10cyclictest23-21ksoftirqd/109:20:011
198850399534,13cyclictest23-21ksoftirqd/108:05:021
198850399534,13cyclictest23-21ksoftirqd/108:05:021
198849899538,6cyclictest131rcu_preempt07:20:020
198849899537,6cyclictest131rcu_preempt08:15:020
1988498995317,9cyclictest12-21ksoftirqd/011:40:000
1988498995311,12cyclictest274-21dbus-daemon12:30:010
1988508995236,11cyclictest1-21systemd11:05:013
1988505995244,5cyclictest1994709-21kworker/2:010:03:412
1988505995241,6cyclictest2003788-21kworker/2:212:40:012
198850399529,5cyclictest131rcu_preempt11:40:021
1988503995218,6cyclictest131rcu_preempt10:30:011
1988503995217,5cyclictest131rcu_preempt07:15:001
1988503995216,5cyclictest131rcu_preempt07:57:251
1988503995213,12cyclictest23-21ksoftirqd/109:50:011
198850399521,10cyclictest23-21ksoftirqd/112:40:001
198849899529,5cyclictest131rcu_preempt08:55:020
198849899527,6cyclictest131rcu_preempt11:50:020
198849899525,10cyclictest12-21ksoftirqd/012:40:000
198849899523,14cyclictest1995358-21grep09:20:020
1988498995217,11cyclictest12-21ksoftirqd/012:15:010
1988505995138,5cyclictest1992566-21kworker/2:208:48:022
198850399519,5cyclictest131rcu_preempt11:25:021
198850399519,5cyclictest131rcu_preempt09:35:011
198850399518,9cyclictest23-21ksoftirqd/111:55:001
198850399518,10cyclictest23-21ksoftirqd/108:55:001
198850399517,8cyclictest23-21ksoftirqd/112:00:021
198850399517,8cyclictest23-21ksoftirqd/110:55:021
198850399517,8cyclictest23-21ksoftirqd/108:10:021
198850399516,11cyclictest23-21ksoftirqd/110:40:001
198850399514,9cyclictest23-21ksoftirqd/109:00:021
198850399514,12cyclictest23-21ksoftirqd/107:40:001
198850399514,11cyclictest23-21ksoftirqd/109:05:021
198850399514,11cyclictest23-21ksoftirqd/109:05:011
1988503995116,5cyclictest131rcu_preempt09:55:011
1988503995115,5cyclictest131rcu_preempt11:00:011
1988503995115,5cyclictest131rcu_preempt11:00:011
1988503995110,6cyclictest131rcu_preempt10:10:001
1988498995115,5cyclictest131rcu_preempt11:15:020
1988498995115,5cyclictest131rcu_preempt11:15:020
1988498995112,6cyclictest131rcu_preempt09:45:020
1988498995111,36cyclictest12-21ksoftirqd/012:05:010
1988498995111,36cyclictest12-21ksoftirqd/012:05:010
1988508995033,13cyclictest1995193-21cat09:20:003
1988505995042,5cyclictest1994709-21kworker/2:012:16:252
1988505995042,5cyclictest1981819-21kworker/2:108:25:072
1988505995035,11cyclictest235-21systemd-journal09:15:012
1988505995016,17cyclictest131rcu_preempt10:25:012
198850399506,8cyclictest23-21ksoftirqd/112:30:441
198850399505,9cyclictest23-21ksoftirqd/111:10:001
198850399505,10cyclictest23-21ksoftirqd/107:45:011
1988503995012,6cyclictest131rcu_preempt07:17:001
198850399501,11cyclictest1992075-21munin-run08:20:011
198850399501,11cyclictest1992075-21munin-run08:20:011
198849899508,9cyclictest131rcu_preempt11:45:010
198849899508,5cyclictest131rcu_preempt08:05:000
198849899508,5cyclictest131rcu_preempt08:05:000
1988498995013,5cyclictest131rcu_preempt11:30:020
1988498995012,6cyclictest131rcu_preempt11:10:030
1988498995012,5cyclictest131rcu_preempt12:25:000
1988498995010,6cyclictest131rcu_preempt10:35:270
1988505994941,5cyclictest1994709-21kworker/2:011:24:462
1988505994941,5cyclictest1994709-21kworker/2:010:36:392
1988505994940,6cyclictest1987643-21kworker/2:207:30:132
1988505994938,7cyclictest1994709-21kworker/2:011:37:212
1988505994920,17cyclictest30-21ksoftirqd/209:30:022
198850599491,5cyclictest131rcu_preempt07:40:002
198850399499,5cyclictest131rcu_preempt07:10:021
198850399498,11cyclictest23-21ksoftirqd/112:15:011
198850399497,10cyclictest23-21ksoftirqd/109:45:021
198850399496,12cyclictest23-21ksoftirqd/108:50:011
198850399494,10cyclictest23-21ksoftirqd/108:30:021
198850399494,10cyclictest23-21ksoftirqd/108:30:021
198849899499,6cyclictest131rcu_preempt08:25:010
198849899496,8cyclictest12-21ksoftirqd/010:55:020
1988498994912,6cyclictest131rcu_preempt07:15:010
1988498994912,5cyclictest131rcu_preempt11:35:010
1988498994910,6cyclictest131rcu_preempt08:45:000
1988508994835,6cyclictest304-21in:imuxsock10:00:003
1988505994841,4cyclictest1994709-21kworker/2:011:46:522
1988505994841,4cyclictest1987643-21kworker/2:207:24:272
1988505994841,4cyclictest1981819-21kworker/2:108:05:482
1988505994840,5cyclictest1994709-21kworker/2:011:57:572
1988505994840,5cyclictest1994709-21kworker/2:011:10:002
1988505994840,5cyclictest1987643-21kworker/2:207:47:082
1988505994840,5cyclictest1987643-21kworker/2:207:27:052
1988505994838,5cyclictest1992566-21kworker/2:209:58:052
198850599483,6cyclictest131rcu_preempt12:10:012
198850399487,10cyclictest23-21ksoftirqd/110:25:011
1988503994816,6cyclictest131rcu_preempt12:10:001
198849899489,6cyclictest131rcu_preempt09:50:000
198849899487,9cyclictest12-21ksoftirqd/012:00:020
198849899486,6cyclictest131rcu_preempt08:00:010
198849899486,11cyclictest12-21ksoftirqd/008:30:000
1988498994816,6cyclictest12-21ksoftirqd/010:25:010
1988498994810,5cyclictest131rcu_preempt07:40:000
198850899479,6cyclictest131rcu_preempt09:10:003
1988505994740,4cyclictest2003788-21kworker/2:212:31:422
1988505994740,4cyclictest1981819-21kworker/2:108:00:202
1988505994740,4cyclictest1981819-21kworker/2:108:00:202
1988505994739,5cyclictest2003788-21kworker/2:212:21:502
1988505994739,5cyclictest1994709-21kworker/2:011:25:342
1988505994739,5cyclictest1994709-21kworker/2:011:10:202
1988505994739,5cyclictest1994709-21kworker/2:011:10:202
1988505994739,5cyclictest1994709-21kworker/2:010:41:082
1988505994739,5cyclictest1994709-21kworker/2:010:28:422
1988505994739,5cyclictest1994709-21kworker/2:010:17:012
1988505994739,5cyclictest1992566-21kworker/2:209:52:092
1988505994739,5cyclictest1992566-21kworker/2:209:48:282
1988505994739,5cyclictest1992566-21kworker/2:209:42:272
1988505994739,5cyclictest1992566-21kworker/2:208:35:452
1988505994739,5cyclictest1987643-21kworker/2:207:52:002
1988505994739,5cyclictest1987643-21kworker/2:207:12:212
1988505994739,5cyclictest1981819-21kworker/2:108:23:002
1988505994739,5cyclictest1981819-21kworker/2:108:11:082
1988505994738,6cyclictest1994709-21kworker/2:012:04:562
1988505994738,6cyclictest1994709-21kworker/2:012:04:562
1988505994721,17cyclictest30-21ksoftirqd/211:44:272
198850399477,5cyclictest131rcu_preempt09:25:021
198849899473,12cyclictest12-21ksoftirqd/007:50:010
1988498994710,5cyclictest131rcu_preempt07:45:010
198850899465,17cyclictest131rcu_preempt08:25:013
1988508994630,12cyclictest37-21ksoftirqd/310:17:003
1988508994629,5cyclictest37-21ksoftirqd/307:35:023
1988505994639,4cyclictest2003788-21kworker/2:212:25:442
1988505994639,4cyclictest1994709-21kworker/2:011:52:232
1988505994639,4cyclictest1992566-21kworker/2:209:00:242
1988505994639,4cyclictest1992566-21kworker/2:209:00:242
1988505994639,4cyclictest1992566-21kworker/2:208:51:112
1988505994639,4cyclictest1992566-21kworker/2:208:40:342
1988505994638,5cyclictest1994709-21kworker/2:011:00:472
1988505994638,5cyclictest1994709-21kworker/2:010:58:022
1988505994638,5cyclictest1994709-21kworker/2:010:58:022
1988505994638,5cyclictest1994709-21kworker/2:010:54:412
1988505994638,5cyclictest1992566-21kworker/2:208:55:532
1988505994638,5cyclictest1992566-21kworker/2:208:31:032
1988505994638,5cyclictest1992566-21kworker/2:208:31:032
1988505994638,5cyclictest1981819-21kworker/2:108:15:412
1988505994638,5cyclictest1981819-21kworker/2:108:15:412
1988505994637,5cyclictest1994709-21kworker/2:010:47:442
1988503994611,6cyclictest131rcu_preempt11:30:021
1988503994611,11cyclictest23-21ksoftirqd/108:40:251
198849899469,5cyclictest131rcu_preempt10:30:020
198849899466,8cyclictest12-21ksoftirqd/008:20:000
198849899466,8cyclictest12-21ksoftirqd/008:20:000
198849899463,9cyclictest12-21ksoftirqd/009:05:010
198849899463,9cyclictest12-21ksoftirqd/009:05:010
1988498994630,12cyclictest1-21systemd09:15:010
1988498994614,5cyclictest131rcu_preempt11:00:010
1988498994614,5cyclictest131rcu_preempt11:00:010
1988498994611,5cyclictest131rcu_preempt07:30:010
1988508994534,9cyclictest37-21ksoftirqd/308:30:013
1988508994529,10cyclictest235-21systemd-journal11:40:003
1988508994526,13cyclictest1-21systemd10:40:003
1988508994526,12cyclictest1-21systemd07:15:003
1988505994538,4cyclictest1994709-21kworker/2:012:11:362
1988505994537,5cyclictest1994709-21kworker/2:011:32:242
1988505994537,5cyclictest1994709-21kworker/2:010:12:542
1988505994537,5cyclictest1992566-21kworker/2:209:22:232
1988505994537,5cyclictest1992566-21kworker/2:209:18:392
1988505994537,5cyclictest1987643-21kworker/2:207:41:112
198850599451,6cyclictest30-21ksoftirqd/207:10:012
198850399453,8cyclictest23-21ksoftirqd/110:05:021
198849899459,6cyclictest131rcu_preempt07:55:010
198849899459,5cyclictest131rcu_preempt08:48:260
198849899453,5cyclictest131rcu_preempt09:55:000
1988498994514,10cyclictest131rcu_preempt07:25:010
1988498994511,6cyclictest131rcu_preempt09:35:020
198849899451,11cyclictest1999080-21latency_hist10:35:010
198850899443,4cyclictest131rcu_preempt09:40:003
1988508994421,15cyclictest274-21dbus-daemon08:35:013
1988508994421,15cyclictest274-21dbus-daemon08:35:013
1988508994413,6cyclictest131rcu_preempt11:45:023
1988505994436,5cyclictest1994709-21kworker/2:011:19:092
1988505994436,5cyclictest1994709-21kworker/2:010:30:472
1988505994436,5cyclictest1994709-21kworker/2:010:08:172
1988505994436,5cyclictest1992566-21kworker/2:209:38:362
1988505994436,5cyclictest1987643-21kworker/2:207:19:042
198849899448,5cyclictest131rcu_preempt08:35:020
198849899448,5cyclictest131rcu_preempt08:35:020
1988508994324,12cyclictest235-21systemd-journal11:35:003
1988508994227,9cyclictest1-21systemd12:10:023
198850899421,3cyclictest131rcu_preempt12:40:023
1988508994120,14cyclictest274-21dbus-daemon08:40:003
198850899411,3cyclictest131rcu_preempt09:30:023
1988508994025,11cyclictest37-21ksoftirqd/308:54:533
1988508994024,12cyclictest274-21dbus-daemon09:00:003
198850899401,7cyclictest131rcu_preempt10:05:013
198849899407,5cyclictest131rcu_preempt10:45:010
198850899395,4cyclictest131rcu_preempt08:20:003
198850899395,4cyclictest131rcu_preempt08:20:003
1988508993928,7cyclictest37-21ksoftirqd/308:15:013
1988508993923,12cyclictest1-21systemd12:25:013
1988508993922,13cyclictest1-21systemd10:55:013
198850899391,8cyclictest131rcu_preempt08:50:023
1988508993917,15cyclictest1998027-21cron10:15:003
198850899391,3cyclictest131rcu_preempt12:35:013
198850899383,6cyclictest131rcu_preempt11:55:003
1988508993820,4cyclictest37-21ksoftirqd/312:20:023
1988508993819,13cyclictest1990261-21cron07:45:003
198850899381,3cyclictest131rcu_preempt12:15:023
198850899381,10cyclictest1990781-21systemd-run07:55:013
198850899378,5cyclictest131rcu_preempt09:48:193
198850899374,3cyclictest131rcu_preempt08:00:023
1988508993729,5cyclictest1999864-21munin-plugin-st10:50:013
1988508993727,8cyclictest37-21ksoftirqd/309:15:023
1988508993721,12cyclictest274-21dbus-daemon07:20:013
1988508993720,12cyclictest235-21systemd-journal10:45:003
198850899369,6cyclictest131rcu_preempt12:30:023
198850899362,6cyclictest0-21swapper/310:10:003
1988508993626,6cyclictest2001095-21latency_hist11:10:033
1988508993617,14cyclictest274-21dbus-daemon11:15:013
1988508993617,14cyclictest274-21dbus-daemon11:15:013
1988508993613,18cyclictest235-21systemd-journal11:25:003
198850899353,3cyclictest131rcu_preempt09:35:003
198850899353,3cyclictest131rcu_preempt07:10:013
1988508993525,6cyclictest304-21in:imuxsock10:30:003
1988508993523,7cyclictest304-21in:imuxsock08:10:003
1988508993519,12cyclictest2003483-21cat12:00:003
198850899351,7cyclictest131rcu_preempt07:25:013
198850899351,5cyclictest131rcu_preempt12:05:013
198850899351,5cyclictest131rcu_preempt12:05:013
1988508993511,4cyclictest37-21ksoftirqd/311:00:013
1988508993511,4cyclictest37-21ksoftirqd/311:00:013
198850899347,7cyclictest37-21ksoftirqd/311:29:013
198850899343,24cyclictest1999086-21cut10:35:013
1988508993424,6cyclictest1998568-21cron10:25:003
1988508993422,8cyclictest235-21systemd-journal08:05:013
1988508993422,8cyclictest235-21systemd-journal08:05:013
1988508993420,11cyclictest37-21ksoftirqd/308:44:593
198850899333,3cyclictest131rcu_preempt09:25:003
198850899331,4cyclictest131rcu_preempt11:20:003
198850899331,3cyclictest131rcu_preempt07:40:003
198850899324,7cyclictest0-21swapper/307:30:013
1988508993221,8cyclictest37-21ksoftirqd/309:54:393
198850899313,3cyclictest131rcu_preempt07:46:243
1988508993119,9cyclictest235-21systemd-journal09:41:273
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional