Skip to main content

Work Process and Memory Management in SAP

Let’s talk about the entire concepts that are related to memory when we talk about SAP Application.



Starting with few basic terminologies,


Local Memory : 


Local process memory, the operating system keeps the two allocation steps transparent. The operating system does the other tasks, such as reserving physical memory, loading and unloading virtual memory into and out of the main memory.



Shared Memory : 


If several processes are to access the same memory area, the two allocation steps are not transparent.


One object is created that represents the physical memory and can be used by various processes. The processes can map the object fully or partially into the address space. The way this is done varies from platform to platform. Memory mapped files, unnamed mapped files, and shared memory are used. 


Extended Memory :


SAP extended memory is the core of the SAP memory management system. Each SAP work process has a part reserved in its virtual address space for extended memory. You can set the size of extended memory using the profile parameter em/initial_size_MB: Extended Memory Pool Size.


Mapping can be done from any extended memory from the common resource to any work process.


[If you have programming understanding , It is majorly used when pointers are involved in ABAP Program]


SAP Swap Memory :


Allocation of memory for the current internal session by transferring pages out of memory, similarly to operating system paging. SAP Paging enables the roll area to be extended at ABAP runtime when a large dataset, internal tables is handled.




Virtual Memory :


Virtual memory is fully independent of the physical main memory.


All operating systems which we use for SAP Applications support virtual memory technology. 


A process allocates virtual memory using logical (virtual) addresses. Each process has its own virtual address space 


Lets understand what is Address Space, The address space consists of a text segment, a data segment, a dynamically extendible heap, and a dynamically extendible stack. 


About Text segment (a.k.a code segment) and data segment. 


Text segment is where you store the program.

Data segment is where you save the data.


About Heap and Stack Memory Allocation :


The heap increases in size from the bottom , The memory is allocated during the execution of instructions written by programmers.

The stack increases from the top and  allocation happens on contiguous blocks of memory, which enables the entire virtual address space to be used. 


This also applies to SAP work processes


Understand it this way , 


With 32-bit systems, 4 GB of memory is theoretically available. Depending on the operating system, there is approximately 2 GB of virtual address space available to a process.


We reserve heap area for SAP Work Processes (we have profile parameters to set them up)


  1. SAP Roll Area : The roll area is area in memory which belongs to a work process(we can configure that ). It is located in the heap of the virtual address space of the work process.


When the context of a work process changes (when the previous work process is completed and new one task take up to that work process ), the data is copied from the roll area to a common resource known as the roll file. To prevent repeated copying, another roll buffer is located in between, which is part of the shared memory.


We have two segments in roll area, 


ztta/roll_first : assigned to the work process first as memory


ztta/roll_area : if the memory that was assigned earlier is used and the work process needs more memory then this memory is assigned.


The amount of memory is determined by the difference between the ztta/roll_area and ztta/roll_first parameters.


Roll area holds data from previous dialog steps and data that characterize the user.


 

  1. SAP Paging Area :  The paging area stores special data for the ABAP processor, while the extended memory stores a large portion of the internal tables of a program.


Parameter which determines this is rdisp/PG_MAXFS


Paging area holds data from the application programs.


What is stored in Paging Area here is an example :


    The ABAP/4 runtime system and the ABAP/4 compiler use a common                    interface to store different types of data in different parts of the SAP paging             area. This data includes the ABAP/4 memory (EXPORT TO MEMORY), the                    SUBMIT REPORT parameters, CALL DIALOG and CALL TRANSACTION                        USING, as well as internally defined macros (specified with DEFINE).


We have a issue mentioned related to SAP Paging which clears more about Paging : Read Here



  1. Private memory : This is nothing but private heap memory as we give the most priority to dialog process we reserve heap memory for the dialog process. After releasing the assigned memory (difference of roll_first and roll_area ), the operating system still considers the (virtual) memory as being occupied by the allocating process. 


The work process can be run in PRIV mode (private) when the local memory is assigned, The work process is reserved for processing the current user context until the context releases the work process again when the request has ended. 


Up to this time point no other user context can be mapped to the work process.


Once the user context is terminated (work process is released, restart : restart occurs when the work process use more local memory than is defined in the parameter abap/heaplimit ) , local memory is returned. 


If a dialog work process has used up the roll area assigned to it and the extended memory, private memory is assigned to the work process. The work process goes into PRIV mode.


In the parameter settings, ensure that not too many dialog work processes are simultaneously in the PRIV mode, since this lowers system performance.


The other work process types , the non dialog work process  (background, update, enqueue and spool work processes) are assigned heap memory after the roll area is used up. Allocating Extended Memory is not useful since no context change occurs for these processes.


Since we are on this topic , lets talk about Automatic Termination of PRIV mode Processes :


If too many dialog work processes run in the PRIV mode in an SAP application server, performance problems arise. The normal processing of user inquiries is slowed down by the PRIV mode work processes.


The SAP system offers a way out that lets you terminate non-active dialog processes in the PRIV mode. 


We set rdisp/wppriv_max_no , say n . What happens after this is if you have more than this number of work process running in private mode. Work processes are active and the time span set in parameter rdisp/max_priv_time has elapsed, the transaction for that PRIV process, which has spent the longest possible time in PRIV mode, is reset



Note :-


rdisp/max_priv_time (default 600 seconds)


rdisp/wppriv_max_no. (Number of dialog work processes - 5 or 1 which ever has the grater value among this two )


Example :- 


If we set rdisp/wpriv_max_no = 5 and rdisp/max_priv_time = 600 second. Then, the SAP system checks periodically if more than 5 dialog work processes are in PRIV mode after 600 seconds (10 minutes). If this is the case, the transaction is reset that has been in PRIV mode for the longest time


Virtual Address Work Space 



 Image Source


What is Memory Allocation ?


Reserving a segment in physical memory , it makes more sense when you take the image as reference. Linking the physical memory segment to the virtual address space of the process, which means reserving a segment of the same size in the virtual address space and mapping the virtual addresses to physical addresses.


Function of SAP Memory Management


An application runs in an SAP work process where an ABAP program is normally executed. The process requires memory to do this, which is allocated to the process by the memory management system.


We have separate way of dealing with Dialog Work Process and Non Dialog Work Process.


This would be the right time for you to understand few more terminologies:-


User Context : 


Temporary memory area that contains information about users which is used throughout the program processing. User information that is stored [Current Settings of the user ,  User Authorizations , Names of program that user are currently using] , Once they log off this memory is released.


The user context area that allows direct access can be extended as required when the size of the user context increases. For dialog work processes, the data of the user context, including internal tables is located in this expanded area. You can therefore access all the data in the user context. Only data of types extract and export to memory still remain in SAP Paging


Roll Area : 


Memory area which is allocated by work processes for the program instance.

Each time a user starts a program, a roll area is created for that instance of the program.Program Information contained [ Dynamic Memory Allocations, Variable Value and Current pointer of the program ] 


The memory in the roll area becomes free when the program ends its execution.


If two users run the same program at the same time then two roll areas will be created one for each user.


The SAP Roll Area is used for the initial memory assigned to a user context, and (if available) for additional memory if the expanded memory is full.


Roll-in: cross-user data is rolled in from the common resource in the work process (and is processed there).


Roll-out: User-specific data is rolled out from the work process in the common resource (after the dialog step has ended)





Image Source (help.sap.com)


Execution of Work Process ->wp in case of Dialog and background Job



In case of Dialog work Process

In case of Background Process


  1. At first Roll_area is used : Based on Parameter Ztta/roll_first.


  1. After that we use the extended memory that is mentioned in em/intial_size_MB and use quota for particular wp which is mentioned in ztta/roll_extension_dia.


  1. After that the left roll area is used (the memory can be calculated by calculating the difference between ztta/roll_area and ztta/roll_first)

  2. Post that we use private memory [Local Heap Memory]

 

Limit of heap memory are configured using these parameters:


abap/heap_area_dia

abap/heap_area_total



  1. OS Limits allocation of Memory , swap space in the host system is used up or the upper limit of the OS address space is reached.




  1. Similarly roll area is used “ztta/roll_area” 


  1. Unlike Dialog work process extended memory are not used right now 


  1. Roll area is already used in this scenario


  1. Heap area is used , Unlike Dialog Work process Private Memory [Local Heap memory] is out of scope.


  1.  Either limit of heap memory is used based on the SAP parameter “abap/heap_area_nondia” or it uses entire heap memory assigned for all the work process and its value based on SAP parameter “abap/heap_area_total”

  2. OS limits allocation memory.

  3. SWAP space is completely used up, Rare to occur.


5. If still required is full then the extended memory is used.






Graphical Representation 


In case of Dialog process :-



In case of Non Dialog Process :-




Note :-  Once work process comes in PRIV mode it  cannot be terminated by the parameter “rdisp/max_wprun_time”, it remains connected to the user until the user ends the transactions or it is timed out by the system due to the memory or explicitly logged out using SM04/DPMON.



Read More :-


help.sap link


SAP Blog by Samar


SAP User Context and Roll Area


Working model Example

SAP Memory Management (BC-CST-MM) - SAP Library

SAP Memory Management Implementations (In Process) - Application Server Infrastructure - SCN Wiki

Memory Parameters - SAP NetWeaver Business Warehouse - SCN Wiki

Cracking SAP Memory Management _Part1

Cracking SAP Memory Management _Part2

Cracking SAP Memory Management _Part3

Memory Allocation and Analysis - Application Server Infrastructure - SCN Wiki




Comments

  1. Well done 👏 very clearly written about SAP memory management..keep it up

    ReplyDelete
  2. Please make some information on ST02 if memory swaps are increasing those things

    ReplyDelete
  3. Your way of writing and making things clear is very impressive. custom erp

    ReplyDelete

Post a Comment

You might find these interesting

How to properly Start/Stop SAP system through command line ?

Starting/stopping an SAP system is not a critical task, but the method that most of us follow to achieve this is sometimes wrong. A common mistake that most of the SAP admins do is, making use of the 'startsap' and 'stopsap' commands for starting/stopping the system.  These commands got deprecated in 2015 because the scripts were not being maintained anymore and SAP recommends not to use them as many people have faced errors while executing those scripts. For more info and the bugs in scripts, you can check the sap note 809477.  These scripts are not available in kernel version 7.73 and later. So if these are not the correct commands, then how to start/stop the sap system?  In this post, we will see how to do it in the correct way. SAP SYSTEM VS INSTANCE In SAP, an instance is a group of resources such as memory, work processes and so on, usually in support of a single application server or database server with

sapstartsrv is not started or sapcontrol is not working

 What is sapstartsrv ? The SAP start service runs on every computer where an instance of an SAP system is started. It is implemented as a service on Windows, and as a daemon on UNIX. The process is called  sapstartsrv.exe   on Windows, and   sapstartsrv   on UNIX platforms. The SAP start service provides the following functions for monitoring SAP systems, instances, and processes. Starting and stopping Monitoring the runtime state Reading logs, traces, and configuration files Technical information, such as network ports, active sessions, thread lists, etc. These services are provided on SAPControl SOAP Web Service, and used by SAP monitoring tools (SAP Management Console,  SAP NetWeaver  Administrator, etc.). For more understanding use this link : https://help.sap.com/doc/saphelp_nw73ehp1/7.31.19/enUS/b3/903925c34a45e28a2861b59c3c5623/content.htm?no_cache=true How to check if it is working or not ? In case of linux , you can simply ps -ef | grep sapstartsrv In case of windows, you need

ST03N : The chapter for all BASIS Admins

This blog is targeted to BASIS ADMINS Transaction for workload analysis statistical data changed over time are monitored using transaction code ST03 , now ST03N (from SAP R/3 4.6C) . With SAP Web AS 6.4 the transaction ST03 is available again. From time to time ST03 and ST03N has seen many changes but later in SAP NW7.0 ST03N has reworked in detail specially processing time is now shown in separate column. Main Use of ST03N  is to get detailed information on performance of any ABAP based SAP system. Workload monitor analyzes the statistical data originally collected by kernel. You can compare or analyze the performance of a single application server or multiple application server. Using this you start checking from the entire system and finding your way to that one application server and narrowing down to exact issue. By Default :- You see data of current day as default view , you can change the default view. Source of the image : sap-perf.ca Let's discuss the WORKLOAD MONITOR By D

HANA System Replication - Prerequisites & Setup

Hey Folks! Welcome back to Hana high availability blog series. In our last blog we checked out operation & replication modes in hana system replication. If you haven't gone though that blog, you can checkout  this link In this blog we will be talking about the prerequisites of hana replication and it's setup. So let's get started. When we plan to setup hana system replication, we need to make sure that all prerequisite steps have been followed. Let's have a look at these prerequisites. HANA System Replication Prerequisites: Primary & secondary systems should be up & running HDB version of secondary should be greater than or equal to Primary database sever But, for Active/Active(read enabled config), HDB version should be same on both sites. System configuration/ini files should be identical on both sides Replication happe

HANA hdbuserstore

The hdbuserstore (hana secure user store) is a tool which comes as an executable with the SAP Hana Client package. This secure user store allows you to store SAP HANA connection information, including user passwords, securely on clients. With the help of secure store, the client applications can connect to SAP HANA without the user having to enter host name or logon credentials. You can also use the secure store to configure failover support for application servers in a 3-tier scenario (for example, SAP Business Warehouse) by storing a list of all the hosts that the application server can connect to. To access the system using secure store, there are two connect options: (1)key and (2)virtualHostName. key is the hdbuserstore key that you use to connect to SAP HANA, while virtualHostName specifies the virtual host name. This option allows you to change where the hdbuserstore searches for the data and key files. Note

How to resolve Common Error : Standard Template "sap_sm.xls" missing

Hey everyone, putting forward a common error we usually face when we have “ Excel inplace” functionality enabled in our SAP system. This error occurs when validity of the signature of SAP standard templates expired or were incorrectly delivered via support packages. We can reproduce the error by doing as below.. Click on “spreadsheet” icon after any SAP ALV grid view of data is on screen to make this data to export into excel directly from SAP.

SAP system migration blog series - part 1: migration overview

Summary : This blog is part 1 of the blog series on SAP system migration. In this blog, we will provide overview about SAP migration, types of migration, their differences and usage scenario. SAP migration overview :   As the Greek philosopher, Heraclitus, said: “change is the only constant.” Same goes within SAP world too, often customer have to change the SAP systems along with its underlying components to meet the changing requirements, be it change from old hardware to new one, changing operating system, database. This change in SAP system components (DB, OS or Hardware) is termed as migration. Before we go into details of migration, let’s understand architecture of a typical SAP system.   An SAP system consist of SAP application instances, running on database (DB), hosted on operating system (OS), provisioned on hardware. Change in any one or more of these underlying components (DB, OS or hardware) warrant us to perform migration. Types of migration:   Broadly, there are two types

ABAP Dumps Analysis

Ever now and then have you heard about ABAP Dumps, We also have a joke everything in temporary in life except ABAP dumps for SAP Consultants. Lets try to understand ABAP dumps from perspective of a SAP BASIS Consultant. Dumps happen when an ABAP program runs and something goes wrong that cannot be handled by the program We have two broad categories of Dumps , In custom program Dumps and SAP provided program Dumps. Dumps that happen in the customer namespace ranges (i.e. own-developed code) or known as Custom Program , can usually be fixed by the ABAP programmer of your team. Dumps that happen in SAP standard code probably need a fix from SAP. You do not have to be an "ABAPer" in order to resolve ABAP dump issues. The common way to deal with them is to look up in ST22 How to correct the error ? Hints are given for the keywords that may be used to search on the note system. Gather Information about the issue  Go to System > Status and Check the Basis SP level as well as info

Complete Guide : XPI Inspector Tool

Content of this blog :           What is an XPI Inspector Tool ? Why XPI Tool is used ? XPI standard URL How to check XPI Tool version ? How to Install/Update XPI version using TELNET How to Use XPI Tool ? References – SAP Notes What is XPI Inspector tool ?          -    XPI Inspector is a diagnostics web application developed by SAP that collects logs and debug traces from various PI components in a very simple way and is useful for SAP PI consultants, developers, and administrators to get more insights on an issue. Why XPI is used  – 1.  Used to collect traces and logs from Messaging system or XI module. 2. Used to collect the related information to solving the issues or improving the PI or PO systems’ performance. 3. Using XPI Inspector application you will be able to collect a lot of information about your system that will help you to learn about problems in the past, to analyze new and detect such at an early stage. 4. Performs certain number of configuration checks, such as SSL c